Skip to content

Training 0.6B model on decontaminated data (Nemotron-CC) #163

@vitiugin

Description

@vitiugin

Compare performance of 0.6B 100BT models trained on Nemotron-CC and decontaminated Nemotron-CC

Metadata

Metadata

Type

No type

Projects

Status

In Progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions