fla-hub/transformer-1.3B-100B

fla-hub/transformer-1.3B-100B is listed on Hugging Face as a text-generation model. This page records the public repository snapshot d6f66f4181fa669e5863327815b44533e3a395e7; verify the listed revision, licence, and runtime support before using it.

Updated

Computraq is preparing for launch. These guides explain readiness and the proposed framework; they do not establish a live service, integration or partnership.

Identity and access

The publisher record identifies this repository as fla-hub/transformer-1.3B-100B. Its current public snapshot is d6f66f4181fa669e5863327815b44533e3a395e7. Access is public repository; review the applicable licence and publisher terms; the recorded licence label is mit. A public repository or gated download does not establish permission for every use.

Configuration facts

The pinned configuration reports model type transformer and architecture TransformerForCausalLM. The model hub tags it for text-generation; these labels describe repository metadata and do not establish benchmark performance.

  • hidden_size: 2048
  • max_position_embeddings: 2048
  • num_hidden_layers: 24
  • rms_norm_eps: 1e-06
  • rope_theta: 10000.0
  • torch_dtype: bfloat16
  • vocab_size: 32000

Model-specific qualification

Before deployment, confirm the exact tokenizer and chat template, supported context length, serving engine, output format, and workload-specific evaluation. The model card and configuration describe artifacts, not an available service or a performance guarantee.

Weight-memory planning

This guide does not retain an independently verified logical parameter count, so it omits a numeric weight-memory estimate. If a count is verified for this exact repository revision, use parameter count × bytes per parameter for a weights-only floor; then account separately for KV cache, context, activations, runtime, and concurrency.

Revision and reproducibility

The metadata and configuration are pinned to revision d6f66f4181fa669e5863327815b44533e3a395e7. Pin this commit when reproducing an evaluation. Repository branches can change, and this source check does not validate the model weights themselves.

Published record

  • Task: text-generation
  • Model type: transformer
  • Architecture: TransformerForCausalLM
  • Licence label: mit
  • Access: public repository; review the applicable licence and publisher terms
  • Revision: d6f66f4181fa669e5863327815b44533e3a395e7

Sources and verification