As Missy said, it means you are "watching" that post and I think it will alert you when other people post to it (like the bell in the upper right corner, or e-mail alerts if that is turned on).
You can actually turn this off in your profile settings to automatically not watch posts you reply to. It would then require you to manually indicate if you want to follow one or not.