@django @MastodonEngineering @Mastodon @FediTips follower only is confusing for that reason.
Your follower that replied to you also used “follower only”.
So one of their follower replied. They could see that first reply even if they couldn’t see the original post (the one you wrote)
It follows whoever wrote the post, not the original post.