data-mixture-doremi-1b

data-mixture-doremi-1b is a 1B-parameter open-weight text language model from Sea AI Lab, trained using the DoReMi data mixture approach and released under the MIT license; it is primarily of interest for data mixture optimization research.