Yes. To turn your bike left, you steer right first. It’s a slight movement, but that quick turn in the opposite direction leans your body into the turn.
Counter steering is one of my favorite things about bicycles. This video uses motorcycles and bikes to explain the concept.
For a more in-depth explanation, read Bicycle Physics.