Markdown source

Reconstructed Slides: The Small Model Infrastructure Nobody Built (So We Did) — Filip Makraduli, Superlinked

Source Video

The Small Model Infrastructure Nobody Built (So We Did) — Filip Makraduli, Superlinked

Method

This deck is reconstructed from the existing video frame captures by detecting likely slide regions with OpenCV, cropping/upscaling those regions, deduplicating similar crops, and OCRing the cropped slide images locally. It is a cleaner companion to the full-stage frame deck.

Reconstructed Slides

slide-003.jpg

Slide text:

AIE AWRTERSDIAAYONA What Actually Makes Embedding

★ ★ ★ ★ ★ Model InferenceFast?

From Fiash Artention to Quintzatoo,whero is the intergnce borteneck? Is it the architecturo, the mathis,or will wniting ovorything in Rust sohve olmy probiems?hdint:

R's Not Rust)

FIUPVAKRADUUI

N22,2V26

Google Dee

AlEngineer

slide-004.jpg

Slide text:

I realised ... I had to learn

slide-005.jpg

Slide text:

LEARNING FROM FIRST PRINCIPLES

I knew models well

Training & fine-tuning

Evaluation & benchmarking

Applied AI research

vLLM, Flash Attention

I had overlooked infrastructure

How models run in production

GPU utilization & scheduling

Routing & autoscaling

Deployment & operations

Best way to learn?

Join the team building it.

slide-006.jpg

Slide text:

SoIjoined theworld class infrastructure team at:

Superlinked github.com/superlinked/sie

AIE VC - backed Al infrastructure company building the model stack for Al search and document processing

Workswithyourfavorite tools

P:Lanceoe OOC 电adamt WWeovoN

erginoering simcle.SIEadcs nstructon-folowng rerankors souopepna dueuogeupue modalraning dacasets and wSEyoucan so-host nfeence for M me reqsred deta transformucior' 'Lenceoe ceotralizes muit- scorng feorrg and ranking host bhem al in one chste comoose the best ndeing modes Weh SE you cen ser- 'Mooern serch sytems uniccis nacural language pre-procnss your outny ag soarchandwnSIEyoucan "Weviee's Query Agene

011022 ceng See AnoeTanycei lco Van Lo C40400-5

AI Engineer

AlEngineer EUROPE

slide-007.jpg

Slide text:

Performance dogrades as context flls up. More tokens,worse answers. Contextrofisrea! Manoges what goes INTO context. Context management

★ ★? AIE ★ Tool calling Emboddings; reranking, extroction

CWhy not Just Opus 4.6?n

Works untif contoxt rot kils guolity

Sourco:Chromo Rosqorch

AlEngineer

AlEngineor EUROPE

hcn

slide-008.jpg

Slide text:

WHYITMATTERSFORYOURAGENTS

Taxonomy classification 10K categories Shopify product catalogue text + images A production story for tool calling Manages what goes INTO context, Context management

AIE title+image Product sio.extract() sie.encode() NU dosicoton emnbedrot- WSOL Electronics Computers,Laptops Tool calling Embeddings:reranking,extraction

sie.score() roronkcordoates

Switching model type = changing one parameter, not rebuilding infra "Why not just Opus 4.6?" Works until context rot kills quality

Engineering the future of Al

Al Enginecr

slide-009.jpg

Slide text:

YIN - MODEL SUPPORTIS KEY, OPEN SOURCEIS NOT STOPPINg

Modcl Pcrformancc vs sizc

AIE ★

3:0

Gommo 4 modol porformonco =your infra noods to koepup

AlEngineer

AEnginccy EUROPE

slide-010.jpg

Slide text:

SAME5STEPS,DIFFERENTIMPLEMENTATION

BERT Qwen2 CoLBERT

1. Norm Post-norm(after) Pre-norm RMSNorm From base arch

2. Q/K/V 3 → we fuse into 1 Separate (GQA) From base arch

AIE

3. Position Absolute lookup RoPE rotation From base arch

4. Attention MHA,allsame GQA (fewer KV) Bidirectioncl

5. Output 1pooledvector 1pooledvector Nvectors(per-token)

Different fromBERT-differentforward pass Differentoutput type entirely

All on packed sequences with flash_attn_varlen = zero padding waste

Engineering the future of Al

AlEnginecr

slide-012.jpg

Slide text:

ILEARNEDMYLESSON ON INFERENCE

We open sourced both the yin (model inference) and the yang (clust

Superlinked

AIE SlE - Superlinked Inference Engine

Dn-scurce dprioxctiencusterererbedsings,rerankirg.ngertrkscn

B.modelyFrreglrctiors.Frem iactcploDibernetes.AlAeache2.o

github.com/superlinked/sie

Google DeepMind

AlEnginecr

Hidden Non-Slide Evidence

Classification audit: raw/sources/slide-ai-classification/reconstructed/qdh_x-uRs9g/audit.json