Hi Jay,
I'd like to confirm if you are using Office 365 Enterprise Pre-upgrade. If you are, you can create a transport rule to forward all the inbound and outbound mails in your organization to a specific mailbox.
Here are the detailed steps:
1. Login to Office 365 Portal with an administrator account.
2. Click "Manage" under "Exchange".
3. Go to "Mail Control", and then click "Rules".
4. Click "New".
5. Click "More Options".
Please note: cancel the Inbox rule where you can forward all the incoming mails to your boss's mail id.
Thanks,
Edward Qu