AKA ANY details about its training data, and its training hyperparameters, and literally any other details about its training. An ‘open’ secret among LLM tinkerers is that the Chinese companies seem to have particularly strong English/Chinese training data (not so much other languages though), and I’ll give you one guess on how.
Deepseek is unusal in that they are open sourcing the general techniques they used and even some (not all) of the software frameworks they use.
Don’t get me wrong, I think any level of openness should be encouraged (unlike OpenAI being as closed as physically possible), but they are still very closed. Unlike, say, IBM Granite models which should be reproducible.
AKA ANY details about its training data, and its training hyperparameters, and literally any other details about its training. An ‘open’ secret among LLM tinkerers is that the Chinese companies seem to have particularly strong English/Chinese training data (not so much other languages though), and I’ll give you one guess on how.
Deepseek is unusal in that they are open sourcing the general techniques they used and even some (not all) of the software frameworks they use.
Don’t get me wrong, I think any level of openness should be encouraged (unlike OpenAI being as closed as physically possible), but they are still very closed. Unlike, say, IBM Granite models which should be reproducible.