1X Launches NEO, A Humanoid Robot For Household Chores

NEO just proved every major AI lab built their vision models wrong OpenAI, Google, Anthropic... they all use the same approach: train a vision encoder, bolt it onto an LLM, pray the alignment works. NEO said "what if we just... didn't do that?" and built a native vision-language model from first principles instead. here's why this is actually insane: traditional VLMs are Frankenstein architectures. you take a pretrained vision encoder (CLIP, whatever). add a projection layer. attach it to a frozen language model. hope they learn to talk to each other. it works. but it's fundamentally fragmented. vision and language compete for model capacity. alignment is expensive. training happens in stages. you're forcing two systems designed for different things to cooperate. NEO throws this out completely. it processes images and text through the same autoregressive architecture — a unified vision-language primitive that learns both modalities natively from scratch. no separate vision encoder. no projection gymnastics. no alignment tax. the technical breakthroughs that make this possible: • Native Multi-Modal Attention with mixed masking - text tokens use causal attention (normal LLM behavior), image tokens use full bidirectional attention (exhaustive visual interactions). each modality processes information its natural way, in the same model, at the same time. • Native-RoPE assigns distinct base frequencies to temporal, height, and width dimensions — solving the critical mismatch between text sequences (temporal) and visual data (spatial). no more forcing spatial information through temporal-only positional embeddings. • Adaptive architecture that uses pre-Buffer layers during pre-training, then merges everything into a monolithic backbone during fine-tuning — automatically allocating capacity for encoding, alignment, and reasoning. the efficiency? 390 million image-text examples. not billions. 390 million. and it rivals GPT-4V and LLaVA. every major lab uses modular architectures because that's what worked first. NEO suggests we've been doing it the expensive, complicated way this whole time.