Does queue STL increase its size itself? Like, when I do push_back in

Yes it increses its size when pushed. The queue like stack is an adapter class. By default it uses std::deque as its underlying container. So any push operation will increase the size of the deque container and in effect the size of the queue adapter just like it happens with a plain vector.