OpenGPT-X
https://opengpt-x.de/en/
In OpenGPT-X, large scale language models are trained and used to create application services as part of the Gaia-X ecosystem. Models will be large, trained on German language, and released into the open.
We support the project in enabling large-scale training on JUWELS Booster and improve the scalability. Also, we will look at new hardware which could solve the tasks more efficiently.