Skip to content

Extend CompressAndTransposeQueriesMatrixAccumulationImpl and - #1007

Open
copybara-service[bot] wants to merge 1 commit into
devfrom
test_975094440
Open

Extend CompressAndTransposeQueriesMatrixAccumulationImpl and#1007
copybara-service[bot] wants to merge 1 commit into
devfrom
test_975094440

Conversation

@copybara-service

Copy link
Copy Markdown

Extend CompressAndTransposeQueriesMatrixAccumulationImpl and
CompressAndQuantizeQueriesMatrixAccumulationInt8Impl in gemma_cpp
to support queries provided as BF16 in addition to float.

Also update AbsMaxOfSpan to support BF16 inputs by promoting lower
and upper vector halves to float in registers, computing absolute
values, and reducing to the maximum float.

CompressAndQuantizeQueriesMatrixAccumulationInt8Impl in gemma_cpp
to support queries provided as BF16 in addition to float.

Also update AbsMaxOfSpan to support BF16 inputs by promoting lower
and upper vector halves to float in registers, computing absolute
values, and reducing to the maximum float.

PiperOrigin-RevId: 975094440
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

0 participants