Looks really promising indeed, I can see how the annotations could be useful and I would never have thought there was something like hypothes.is that could do this and could be combined with Gitbuilding in this way. Nice work.
Not sure which tool you are talking about exactly but for Gitbuilding contributions are always welcome.