Hierarchos experiment
hello guys! im the guy who built hierarchos! i know the page says to create a pull request, but i dont want to modify any of the projects files for that, it seems sloppy. do i put my model link here?
if so, here is the model: https://huggingface.co/netcat420/KortexHOS
thank you so much to Michael Morgan for taking an interest in my model! :3
Hi Netcat, this is a really awesome model with a fascinating architecture! However unfortunately our leaderboard is currently for sub 150ish m parameter models so we will be unable to add it.
okee! thank you for taking a look at it! we do plan to release a smaller model with the planned v2 release! we plan to scale up to a larger dataset now that our codebase is verified and working. we plan to release another 232M param model, and then a 75M param model for v2! would you be interested in the smaller version of that family when it does come to finish?
Yeah most certainly! That sounds awesome, can't wait to see how the v2 performs!