No, you’re not alone - a fellow stats nerd here.
I go a little bit more high tech with the ‘On My Wrist’ iPhone App, which allows you to input your collection & then a quick swipe & tap notes the watch worn each day thereafter (only room for one daily, mind), and then creates an overall bar chart of cumulative total wearing stats over various time periods.
You can also store handy data like date acquired, price paid, date of last service, price sold for etc.