Add position ids for pretokenized data - #430

Add position ids for pretokenized data#430

timofeev1995 wants to merge 2 commits into

maintogethercomputer/together-python:mainfrom

positions-ids-for-tokenized-datatogethercomputer/together-python:positions-ids-for-tokenized-dataCopy head branch name to clipboard