It’s definitely sucking up to you. It’s programmed to confirm what you say, because that means you keep using it.

Consider how you phrase your questions. Try framing a scenario from the position of your boss, or ask “why was my boss right to say x, y, z”, and it’ll still agree with you despite the opposite position.

If you’re just shooting the shit, consider doing it with a human being. Preferably in person, but there are plenty of random online chat groups too