If I buy your Mentions system, can it be used in the Shoutbox chat window?

No, but an integration shouldn't be that hard, maybe it can be added soon.

I would love to see the mention work with shoutbox. I'd also love to see your emoji picker integrated with the Shoutbox emoji button. I'm going to submit a ticket for custom work and see what we can figure out.