Large black ants with wings

I've been seeing large black ants with wings around my bedroom window. I didn't see them last year but I did notice some big black ants walking outside the house on the wall just below that same window. Now I'm thinking these are related. Do I have some kind of ant problem?

You're describing carpenter ants and I'm pretty sure the ones with wings are carpenter ant swarmers. These are reproductives which colonies send out every spring to start new colonies. Since they will only emerge from established nests, it's reasonable to assume you had an active nest last year which is now releasing these ants to go and start new colonies somewhere else. Because the nest is on the home, some are finding their way inside instead of outside where they really want to be. Since carpenter ants can cause a lot of damage to wood, you'll need to treat the nest as described in our carpenter ant control article.