Gemma4 model implementation#460

Draft

edenamram wants to merge 6 commits into

elixir-nx:mainfrom

edenamram:gemma4-model-implementation

Commits on Jun 9, 2026

Add Gemma4 model implementation and update model mappings
edenamram
committed

Commits on Jun 13, 2026

Gemma4Text to enhance cache initialization and attention head size handling
edenamram
committed
Implement per-layer input handling in Gemma4 model and add ChunkedFileTensor for large tensor support
edenamram
committed

Commits on Jun 15, 2026

Add value_norm option to transformer layers and update Gemma4Text normalization
edenamram
committed
Add rotary_dim option to rotary embedding layer and update Gemma4Text configuration
edenamram
committed

Commits on Jun 16, 2026

Refactor rotary embedding options and improve parameter mapping in Gemma4Text
edenamram
committed