【SenseNova U1.5 Lite 实战】

做多模态的人都有一个隐隐的痛：想让模型"看懂图再画图"，你得把 VLM 和 Diffusion 两个世界用胶水粘起来。视觉编码器（VE）把图压成特征给 LLM 理解，变分自编码器（VAE）把图压成 latent 给扩散模型生成——两套表征空间、两套训练管线，中间的"翻译损耗"几乎无法消除。

商汤开源的 SenseNova-U1 想做的事情很激进：把 VE 和 VAE 都扔掉，让像素和词元在同一个 Transformer 里直接对话。这篇博客基于官方技术报告与仓库文档，从架构动机、核心技术、本地部署到实践建议，把它拆开讲清楚。

• 项目信息：GitHub OpenSenseNova/SenseNova-U1
• 技术报告 arXiv:2605.12500。

---

一、为什么要原生统一

传统多模态方案的分裂不是工程偷懒，而是架构使然：

• 理解侧：图片 → VE（如 CLIP ViT）→ 特征向量 → LLM
• 生成侧：图片 → VAE Encoder → latent → Diffusion → VAE Decoder → 图片

这两条路径有不同的学习目标、不同的训练流程，产出表征空间天然错位。早期统一多模态模型（Show-o、Janus、BAGEL 等）试图用共享主干把它们捏在一起，但本质上仍受限于不同的 tokenizer 或扩散头，理解和生成在表征层是脱节的。

SenseNova-U1 的核心主张是回到第一性原理：让模型直接从原生输入（像素+文字）学习，不依赖任何预训练编码器的先验。这就是 NEO-unify 架构想解决的问题。

---

二、NEO-unify 架构

SenseNova-U1 基于 NEO-unify，从三个递进层级解决了统一路上的矛盾。

1. 接口层：近无损视觉接口，彻底去掉 VE 和 VAE

这是最反直觉的一步。

**Patch Encoding：输入图片经过两层卷积（stride=16 和 stride=2，GELU 激活 + 2D 正弦位置编码），每个 token 对应 32×32 像素块。**文本词元走原 LLM 的 tokenizer，两者投影到共享嵌入空间。

Patch Decoding：

• 理解流用线性头映射到词表，做文本预测
• 生成流用 MLP 头直接回归原始像素块，绕过 VAE 解码器

消融实验给出了关键证据：2B NEO-unify 在 MS-COCO 2017 上图像重建 PSNR 达 31.56、SSIM 0.85，接近 FLUX VAE 的 32.65 / 0.91。也就是说，无编码器并不牺牲像素级保真。

2. 训练层：分辨率自适应噪声尺度

像素空间 flow matching 有个隐藏问题：当分辨率从 256² 跨度到 2048²，生成 token 数量差异巨大，固定方差的高斯噪声先验会导致不同分辨率下信噪比（SNR）不一致。

NEO-unify 引入动态噪声尺度：

σR(H,W)=σ0N(H,W)/N0

其中 N=(H⋅W)/322 是生成 token 数。噪声标准差随 token 数平方根增长，保证每个 token 在不同尺度下承受大致恒定的噪声能量。这个尺度还会被正弦 MLP 编码器处理后，与时间步嵌入相加，作为条件送入去噪器。

3. 参数层：原生 Mixture-of-Transformers（MoT）

这是理解+生成共存且不打架的关键。

MoT 的设计哲学是知识共享、专才专用：

• 理解流处理干净的图像+文本，生成流处理噪声条件输入
• 两者在同一个序列里、在共享的自注意力机制下处理
• 但 Q/K/V/O 投影、归一化、FFN 完全参数解耦，按 token 类型动态路由

文本 token: 因果注意力（只看前文）
图像 token: 块内双向 + 对前文因果
噪声 token: 块内双向 + 可访问干净输入，但干净 token 不能看噪声

为了对齐一维语言和二维图像，NEO-unify 把 RoPE 的头维度重新分配到 T（时间）/ H（空间高度）/ W（空间宽度）三个轴，各自有独立频率基，零额外参数。

两个官方模型变体：

模型	理解流	生成流	特点
8B-MoT	稠密 8.2B	稠密 8.2B	对称并行，单卡友好
A3B-MoT	MoE 30B（128 专家）	MoE 8.2B（32 专家）	每次激活约 3B 参数

训练目标：双损失联合优化

Ltotal=λ1LUnd+λ2LGen

• LUnd：标准下一词元预测
• LGen：像素空间 flow matching 的 MSE 速度损失

训练分 6 个阶段渐进**：理解 Warmup → 生成预训练（三阶段）→ 统一中训 → 统一 SFT → T2I 强化学习后训练（Flow-GRPO + 多奖励）→ CFG & 步数蒸馏**（DMD2 把 NFE 从 100 步压到 8 步）。

---

三、能力边界

根据技术报告评测，SenseNova-U1 在多个基准上达到开源 SOTA：

图像理解：MMMU 74.78（8B-Think）、MMBench-EN 90.25、MathVision 75.82，在 STEM 推理、空间智能（VSI-Bench 62.66）等维度明显超过同规模 Qwen3VL-8B。

图像生成：

• GenEval 总体 0.91，超过 Qwen-Image（0.87）、BAGEL（0.82）
• DPG-Bench 上 A3B 版本 Global 维度 94.19，为全场最高
• 在文本渲染密集型任务（CVTG-2K、LongText-Bench）上领先明显

图像编辑与图文交错：在 GEdit-Bench、RISEBench、OpenING 等基准上均为开源第一梯队。

但要诚实地说：在超写实人像的皮肤质感、光照细节上，闭源模型（Seedream 4.5、GPT-Image-1）仍有优势；

SenseNova-U1 的真正长板在信息图、海报、文字渲染、图文交错这些结构化视觉生成任务上。

五大核心能力一览：

1. 多模态理解：VQA、OCR、空间推理、数学视觉，32K 上下文
2. 文生图 T2I：U1.5 支持原生 4K，8 步 LoRA 加速
3. 图像编辑：支持物理常识推理式编辑
4. 图文交错生成：单次 prompt 自动交替输出文字+配图，适合教程、绘本
5. VLA / 世界建模：面向具身智能的初步探索

---

四、本地部署

1. 环境准备（按官方推荐）

git clone https://github.com/OpenSenseNova/SenseNova-U1.git
cd SenseNova-U1

官方当前推荐环境：Python 3.11、torch 2.8、CUDA 12.8，用 uv 管理：

uv --project . sync --locked
source .venv/bin/activate

sensenova_u1 包会以 editable 模式安装，自动向 transformers 注册 NEO-Unify 模型。

2. 四种运行途径

途径	适用场景
SenseNova-Studio 网页版	零安装，在线试用全部能力
HuggingFace Transformers 本地推理	完整功能，推荐研究和体验
ComfyUI 节点	可视化调参，但不支持图文交错
LightLLM + LightX2V 生产部署	官方推荐的生产方案，理解引擎和生成引擎解耦

3. 本地推理：四个核心任务

文生图：

python examples/t2i/inference.py \
  --model_path sensenova/SenseNova-U1.5-8B-MoT \
  --prompt "A formal portrait depicts a man in 18th-century attire seated with a scroll, wearing a red cloak and ornate medals, against a classical landscape with ancient ruins and inscriptions." \
  --output output.png  \
  --vram_mode balanced

图像编辑：

 python examples/editing/inference.py  --model_path sensenova/SenseNova-U1.5-8B-MoT  --prompt "Change the animal's fur color to a darker shade."   --image examples/editing/data/images/1.webp   --cfg_scale 4.0 --img_cfg_scale 1.0   --cfg_norm none --timestep_shift 3.0   --num_steps 50 --output output_edited.png --compare --vram_mode balanced

图文交错生成（特色能力）：

python examples/interleave/inference.py \
  --model_path sensenova/SenseNova-U1.5-8B-MoT \
  --prompt "I want to learn how to cook tomato and egg stir-fry. Please give me a beginner-friendly illustrated tutorial." \
  --resolution "16:9" \
  --output_dir outputs/interleave/ \
  --stem demo --profile  --vram_mode balanced

模型会输出结果如下:

# PROMPT
I want to learn how to cook tomato and egg stir-fry. Please give me a beginner-friendly illustrated tutorial.

# OUTPUT
<think>
No problem! As a classic home-cooked dish, the secret to a great Tomato and Egg Stir-fry lies in the balance of "sour, sweet, and fresh" and the texture of the eggs. Before we start, let's plan our approach. This tutorial is designed to help you recreate a restaurant-quality dish in your own kitchen. We will focus on three core techniques: first, "scoring the tomatoes" to ensure they release their juices; second, "stirring the eggs" to achieve a fluffy, tender texture; and third, "simmering the sauce" to create a glossy, rich glaze. We'll use a warm, natural visual style, focusing on the vibrant red of the tomatoes and the golden yellow of the eggs. Let's start by looking at the final result: a plate of bright, appetizing stir-fry with a thick, glossy sauce and perfectly cooked eggs.

# Image Generation Prompt
A close-up, high-angle shot of a rustic ceramic bowl filled with tomato and egg stir-fry. The dish features large, soft chunks of bright red tomatoes and fluffy, golden-yellow scrambled eggs coated in a thick, glossy, translucent orange-red sauce. A small garnish of fresh green cilantro sits in the center. The bowl is placed on a textured, light-colored linen napkin atop a weathered wooden table. In the soft-focus background, a small dish of white salt and a wooden spoon are visible. Natural, warm side-lighting from a window creates soft highlights on the sauce and gentle shadows, emphasizing the moist, tender textures. The atmosphere is cozy and appetizing, with a shallow depth of field focusing on the vibrant colors and rich glaze of the food.
<image1>
<image>
Preparation is key. You'll need two or three large, ripe tomatoes (the redder and softer, the better), two fresh eggs, a bit of sugar, salt, and a small piece of ginger. For tools, a sharp knife, a wooden cutting board, a non-stick pan, and a spatula are essential. In the image below, you can see the ingredients neatly arranged: the tomatoes are washed and ready, the eggs are waiting, and the seasonings are lined up. This organized setup helps you stay calm and focused during the cooking process.

# Image Generation Prompt
High-angle culinary still life on a light-grained wooden table. A central ceramic bowl holds two large, ripe red tomatoes with green stems. To the left, a small wooden bowl contains two brown eggs. To the right, a small dish holds a pile of white salt and a tiny bowl of sugar. A stainless steel chef's knife with a dark wooden handle rests on a folded beige linen napkin. Soft, natural daylight from a side window illuminates the scene, creating gentle shadows and highlighting the smooth textures of the fruit and the matte finish of the ceramics. The composition is clean and organized, featuring a warm, rustic color palette of red, brown, and cream. Sharp focus on the ingredients with a shallow depth of field blurring the background window frame.
<image2>
<image>
Now for the first step: prepping the tomatoes. Many beginners find their tomatoes won't release juice because they are cut too thick. The secret is to score a shallow "cross" on the top of each tomato with your knife. Then, cut them into 1.5cm cubes. As shown in the image, the tomatoes are cut into uniform pieces with the cross-hatch marks clearly visible. This increases the surface area, allowing the tomatoes to release their natural pectin and juices much faster once they hit the pan.

# Image Generation Prompt
High-angle close-up of a light-grained wooden cutting board featuring a pile of freshly diced red tomatoes. Each tomato cube is approximately 1.5cm, displaying a distinct cross-hatch score on the top skin. The tomatoes are moist and glistening, with visible seeds and juicy pulp. A sharp stainless steel chef's knife with a dark wooden handle rests diagonally on the right side of the board. Soft, natural daylight from a side window illuminates the scene, creating gentle highlights on the tomato surfaces and casting soft shadows. The background is a minimalist, out-of-focus kitchen setting with a neutral-toned countertop. The composition emphasizes the vibrant red of the fruit against the warm wood, capturing a clean, culinary atmosphere with sharp focus on the textures of the cut vegetables.
<image3>
<image>
Next, let's prepare the eggs. Crack the eggs into a bowl and add a pinch of salt. Salt helps break down the protein, making the eggs fluffier. Whisk them thoroughly until the whites and yolks are fully combined. In the image, you can see the whisking process in a ceramic bowl, creating a smooth, golden liquid. This ensures the eggs will cook evenly and won't have any raw pockets.

# Image Generation Prompt
Close-up, high-angle shot of a hand whisking a golden egg mixture in a speckled ceramic bowl. The bowl sits on a light-grained wooden table. A stainless steel whisk with a dark wooden handle is submerged in the liquid, creating a smooth, frothy surface. Soft, natural daylight from a side window illuminates the scene, casting gentle shadows and highlighting the glossy texture of the eggs. In the blurred background, a small wooden bowl holds two brown eggs, and a folded linen napkin rests nearby. The composition features a shallow depth of field, focusing on the whisking action. The color palette is warm and neutral, emphasizing the vibrant yellow of the eggs against the earthy tones of the wood and ceramic. The atmosphere is clean and domestic, capturing a quiet moment of food preparation.
<image4>
<image>
Now, turn the heat to medium and add a bit of oil to the pan. When the oil is hot, pour in the egg mixture. You'll hear a satisfying sizzle. Use your spatula to gently break the eggs into large, fluffy pieces as they set. Don't overcook them; as soon as they are 80% set and still look moist, scoop them out and set them aside. The image shows the golden eggs in the pan, looking light and airy, ready to be reunited with the tomatoes.

# Image Generation Prompt
Close-up, high-angle shot of a black non-stick frying pan on a gas stove. Inside, large, fluffy scrambled eggs are being cooked in shimmering oil, showing a mix of bright yellow and pale white textures. A stainless steel spatula with a dark wooden handle is captured mid-motion, breaking the eggs into airy, moist curds. The pan sits on a black cast-iron grate over a silver burner. The background features a light-colored wooden countertop and a soft-focus window providing bright, natural side-lighting. The lighting creates sharp highlights on the glossy oil and the moist surfaces of the eggs. The composition is tight, focusing on the culinary action with a shallow depth of field that blurs the kitchen environment. The color palette is dominated by warm yellows, deep blacks, and neutral wood tones, emphasizing a clean, domestic atmosphere.
<image5>
<image>
This is the most important part: cooking the tomatoes. Add a little more oil to the pan (or use the residue), then add the tomato cubes. Stir-fry over medium-low heat. As the heat penetrates, the tomatoes will soften and release their red juice. Use your spatula to press down on the tomatoes to speed up the process. In the image, you can see the tomatoes turning into a thick, bubbling red sauce. This "sauce" is the soul of the dish.

# Image Generation Prompt
Close-up, high-angle shot of a black non-stick frying pan on a gas stove burner. Inside, diced red tomatoes are being stir-fried in shimmering oil, releasing a thick, bubbling red sauce. A stainless steel spatula with a dark wooden handle is captured mid-motion, pressing into the softened tomato cubes. The pan sits on a black cast-iron grate over a silver burner. The background features a light-colored wooden countertop and a soft-focus window providing bright, natural side-lighting. The lighting creates sharp highlights on the glossy oil and the moist, textured surfaces of the tomatoes. The composition is tight, focusing on the culinary process with a shallow depth of field that blurs the kitchen environment. The color palette is dominated by vibrant reds, deep blacks, and warm wood tones, emphasizing a clean, domestic atmosphere.
<image6>
<image>
Finally, it's time to combine everything. Add a teaspoon of sugar to balance the acidity and a pinch of salt to enhance the flavor. Pour the cooked eggs back into the pan. The red sauce will immediately coat the golden eggs. Give it a quick toss to ensure every piece is glazed. As you can see in the final image, the eggs and tomatoes are perfectly intertwined in a rich, glossy sauce. Turn off the heat and serve immediately while it's hot!

# Image Generation Prompt
Close-up, high-angle shot of a black non-stick frying pan on a gas stove burner. Inside, golden scrambled eggs are stir-fried with large, soft chunks of red tomatoes in a thick, glossy, bubbling sauce. A stainless steel spatula with a dark wooden handle is captured mid-toss, lifting the ingredients. The pan sits on a black cast-iron grate over a silver burner. The background features a light-colored wooden countertop and a soft-focus window providing bright, natural side-lighting. The lighting creates sharp highlights on the oily sauce and the moist textures of the food. The composition is tight, focusing on the vibrant red and yellow colors against the dark pan. The atmosphere is warm and domestic, emphasizing the fresh, home-cooked meal.
<image7>
<image>
</think>

Tomato and egg stir-fry is a classic home-cooked dish that relies on a balance of "sour, sweet, and fresh" flavors. To help you master this, we will focus on three core techniques: scoring the tomatoes for juice, stirring the eggs for fluffiness, and simmering the sauce for a glossy glaze. 

Here is your step-by-step guide to achieving restaurant-quality results at home.

### 1. Preparation
Gather your ingredients: two or three large, ripe tomatoes (the redder and softer, the better), two fresh eggs, sugar, salt, and a small piece of ginger. Having everything organized on your cutting board and in small bowls will help you stay focused once the heat is on.
<image2>

### 2. Prep the Tomatoes
The secret to a juicy sauce is how you cut the tomatoes. Score a shallow "cross" on the top of each tomato with your knife, then cut them into 1.5cm cubes. This increases the surface area, allowing the tomatoes to release their natural pectin and juices much faster once they hit the pan.
<image3>

### 3. Whisk the Eggs
Crack the eggs into a bowl and add a pinch of salt. Salt helps break down the protein, making the eggs fluffier. Whisk them thoroughly until the whites and yolks are fully combined into a smooth, golden liquid.
<image4>

### 4. Cook the Eggs
Heat a bit of oil in a non-stick pan over medium heat. When the oil is hot, pour in the egg mixture. Use your spatula to gently break the eggs into large, fluffy pieces as they set. Don't overcook them; as soon as they are 80% set and still look moist, scoop them out and set them aside.
<image5>

### 5. Simmer the Tomato Sauce
Add a little more oil to the pan and add the tomato cubes. Stir-fry over medium-low heat. As the heat penetrates, the tomatoes will soften and release their red juice. Use your spatula to press down on the tomatoes to speed up the process until they turn into a thick, bubbling red sauce.
<image6>

### 6. Combine and Season
Add a teaspoon of sugar to balance the acidity and a pinch of salt to enhance the flavor. Pour the cooked eggs back into the pan. The red sauce will immediately coat the golden eggs. Give it a quick toss to ensure every piece is glazed, then turn off the heat and serve immediately.
<image7>

### The Final Result
You now have a plate of bright, appetizing stir-fry with a thick, glossy sauce and perfectly cooked eggs.
<image1>

视觉理解：

用户想根据提供的菜单为两人推荐餐食组合。限制条件：

• 2人。
• 均衡的一餐（主菜 + 可能的前菜或甜点）。
• 预算有限。
• 想尝试招牌菜。

python examples/vqa/inference.py \
  --model_path sensenova/SenseNova-U1.5-8B-MoT \
  --image examples/vqa/data/images/menu.jpg \
  --question "My friend and I are dining together tonight. Looking at this menu, can you recommend a good combination of dishes for 2 people? We want a balanced meal — a mix of mains and maybe a starter or dessert. Budget-conscious but want to try the highlights." \
  --output outputs/answer.txt \
  --max_new_tokens 8192 \
  --do_sample \
  --temperature 0.6 \
  --top_p 0.95 \
  --top_k 20 \
  --repetition_penalty 1.05 \
  --profile \
  --vram_mode balanced

<think>
The user wants a meal recommendation for two people based on the provided menu.
**Constraints:**
- 2 people.
- Balanced meal (mains + maybe starter/dessert).
- Budget-conscious.
- Want to try highlights.

**Analysis of the Menu:**

*   **Skewers + Sides (Left Column):**
    *   *Char-grilled chicken satay:* 158 HKD. Good starter, but expensive.
    *   *Char-grilled coconut & chilli prawn skewers:* 148 HKD. Good starter.
    *   *Char-grilled Wagyu M37 beef skewers:* 198 HKD. Expensive, good highlight.
    *   *Fresh made Roti:* 58 HKD. Very cheap side/starter.
    *   *Wok fried Thai watercress:* 88 HKD. Side.
    *   *Thai jasmine rice:* 30 HKD. Side/Carb base.

*   **Curries (Center Column - Top):**
    *   *Khao Soi:* 168 HKD. Popular, good main.
    *   *Massaman curry:* 258 HKD. Expensive, very rich.
    *   *Spicy turmeric curry:* 248 HKD. Expensive.
    *   *Aromatic curry:* 238 HKD. Expensive.

*   **Wok Stir-fry (Center Column - Bottom):**
    *   *Fried rice with Wagyu beef:* 168 HKD. Main.
    *   *Fried rice with crabmeat & spring onions:* 168 HKD. Main.
    *   *Pad Thai:* 158 HKD. Classic, good value.
    *   *Stir fried spicy Wagyu beef:* 188 HKD. Good main.
    *   *Stir fried chiltoen & flat noodles:* 148 HKD. Good main.
    *   *Wagyu beef wok fried:* 158 HKD. Good main.
    *   *Thai omlette:* 178 HKD. Main.

*   **Sweet Roti (Right Column - Top):**
    *   *Fresh made roti:* 78 HKD.
    *   *Fresh made banana roti:* 108 HKD.
    *   *Add-ons:* 40 HKD.

*   **Desserts (Right Column - Bottom):**
    *   *Thai mango sticky rice:* 98 HKD.
    *   *Coconut ice cream:* 88 HKD.
    *   *Thai red tea ice cream:* 88 HKD.
    *   *Pandan ice cream:* 88 HKD.
    *   *Pandan & coconut dumplings:* 88 HKD.

**Budget Calculation Strategy:**
Total budget needs to be reasonable for a casual dinner. Let's aim for a total spend between 350 - 450 HKD to stay "budget-conscious" while getting quality food.

**Option 1: The "Classic Thai Comfort" Combo**
*   **Mains:** Pad Thai (158) + Fried Rice with Crabmeat (168) = 326 HKD.
*   **Sides/Starter:** Fresh Roti (58) + Thai Jasmine Rice (30) = 88 HKD.
*   **Total:** ~414 HKD.
*   *Critique:* Good variety, covers mains and sides. Maybe a bit dry without soup, but the menu doesn't list soups clearly (unless the curries count). Wait, looking closer at the top left, there isn't a soup section explicitly listed, just skewers. The curries are heavy.

**Option 2: The "Meat Lover's Budget" Combo (Trying the Highlights)**
*   **Main 1:** Char-grilled Wagyu Skewers (198) - This is the most expensive item but the "highlight."
*   **Main 2:** Massaman Curry (258) - Also expensive, but very popular.
*   **Side:** Fresh Roti (58).
*   **Total:** 198 + 258 + 58 = 514 HKD.
*   *Critique:* A bit tight on budget if they want dessert, but doable. Maybe swap the Massaman for the Aromatic Curry (238)? Still tight.

**Option 3: The "Balanced & Value" Combo**
*   **Mains:** Pad Thai (158) + Spicy Turmeric Curry (248) - Wait, too expensive.
*   Let's look at the Wok dishes again. They seem more affordable than the curries.
*   **Mains:** Stir-fried Spicy Wagyu Beef (188) + Fried Rice with Crabmeat (168) = 356 HKD.
*   **Starter/Side:** Fresh Roti (58) + Thai Jasmine Rice (30) = 88 HKD.
*   **Total:** 444 HKD.
*   **Dessert:** Thai Mango Sticky Rice (98) OR Coconut Ice Cream (88). Let's say 90 HKD.
*   **Grand Total:** ~532 HKD. This feels a bit high for "budget-conscious."

**Refining Option 3 for Budget:**
Let's cut the Wagyu beef dish.
*   **Mains:** Pad Thai (158) + Fried Rice with Crabmeat (168) = 326 HKD.
*   **Starter:** Fresh Roti (58).
*   **Rice:** 30 HKD.
*   **Dessert:** Coconut Ice Cream (88).
*   **Total:** 326 + 58 + 30 + 88 = 502 HKD. Still a bit pricey for a "budget" request, but reasonable for a nice dinner.

**Let's try a truly budget-friendly approach:**
*   **Mains:** Pad Thai (158) + Fried Rice with Chiltoen (148) = 306 HKD.
*   **Starter:** Fresh Roti (58).
*   **Rice:** 30 HKD.
*   **Total so far:** 394 HKD.
*   **Remaining budget:** ~100 HKD.
*   **Dessert:** Coconut Ice Cream (88). Total: 482 HKD.
*   *This is a solid recommendation.*

**Let's try a "Highlight" focused approach:**
The user specifically asked to "try the highlights." The highlights are likely the **Wagyu Skewers**, the **Wagyu Beef Wok**, and the **Massaman Curry**.
*   **Mains:** Char-grilled Wagyu Skewers (198) + Massaman Curry (258). That's 456 HKD already.
*   **Side:** Fresh Roti (58). Total 514 HKD.
*   This leaves almost nothing for dessert or rice.
*   *Correction:* You can share the skewers. The price is likely per order, not per person? The menu usually lists prices per portion. "Char-grilled Wagyu M37 beef skewers (200gm)" implies one order.
*   If you order the skewers (198), that's enough for both of you to have some meat.
*   Then order the Massaman Curry (258) for sharing.
*   Total: 198 + 258 + 58 (Roti) = 514 HKD.
*   Add a drink? (Not on menu, assume drinks are separate).
*   This is a very strong "highlight" meal.

**Final Selection Strategy:**
I will offer three distinct recommendations ranging from "Budget Friendly" to "Highlight Seeker."

1.  **The "Classic & Shareable" Combo (Best Balance):**
    *   **Mains:** Pad Thai (158) + Fried Rice with Crabmeat (168). These are crowd-pleasers.
    *   **Starter/Side:** Fresh Made Roti (58) + Thai Jasmine Rice (30).
    *   **Dessert:** Coconut Ice Cream (88).
    *   **Total:** ~444 HKD. Very balanced.

2.  **The "Wagyu Highlight" Combo (For the Meat Lovers):**
    *   **Main 1:** Char-grilled Wagyu Skewers (198). Great for sharing.
    *   **Main 2:** Massaman Curry (258). Rich and creamy.
    *   **Side:** Fresh Made Roti (58).
    *   **Total:** ~514 HKD. Expensive but hits the "highlight" request hard.

3.  **The "Budget & Curiosity" Combo:**
    *   **Main:** Khao Soi (168). It's a famous bowl.
    *   **Side:** Fresh Made Roti (58).
    *   **Rice:** 30.
    *   **Dessert:** Pandan Ice Cream (88).
    *   **Total:** ~344 HKD. Very budget friendly.

**Wait, let me look at the menu again for hidden deals.**
The menu says "All prices are in HKD dollars and subject to an additional 10% service charge."
The "Fresh made Roti" is 58. That's a great starter.

**Revised Recommendation Structure:**
I'll present a few "sets" so they can choose based on how much they want to spend.

*   **Set 1: The Balanced Classic (Approx. $400 HKD)**
    *   Mains: Pad Thai ($158) + Fried Rice with Crabmeat ($168)
    *   Starter: Fresh Roti ($58)
    *   Rice: Thai Jasmine Rice ($30)
    *   Dessert: Coconut Ice Cream ($88)
    *   *Why:* Covers everyone's bases, varied textures.

*   **Set 2: The "Highlight" Meat Lover (Approx. $500+ HKD)**
    *   Mains: Char-grilled Wagyu Skewers ($198) + Massaman Curry ($258)
    *   Starter: Fresh Roti ($58)
    *   *Why:* You get the most expensive items on the menu. The skewers are great for sharing.

*   **Set 3: The Budget Option (Approx. $350 HKD)**
    *   Main: Khao Soi ($168)
    *   Side: Fresh Roti ($58)
    *   Rice: ($30)
    *   Dessert: Pandan Ice Cream ($88)
    *   *Why:* You save money and still get a famous dish (Khao Soi).

**Specific Dish Details to include in the response:**
*   Mention the **Khao Soi** is a bowl of curry with noodles.
*   Mention the **Pad Thai** is a classic stir-fry.
*   Mention the **Wagyu** options are premium.

**Final Polish:**
Make sure to mention the currency is HKD. Mention the service charge (10%) adds about 10% to the total.
The prompt asks for "a good combination." I will provide one primary recommendation and then alternatives.

**Primary Recommendation:**
**The "Share the Richness" Combo**
*   **Mains:** **Massaman Curry** ($258) and **Khao Soi** ($168). Wait, that's 426 right there.
*   Let's go back to the **Pad Thai + Crab Rice** combo. It's safer for a "balanced meal."
*   Actually, the **Wagyu Skewers** are a huge draw. I should definitely feature them.
*   Let's suggest: **Char-grilled Wagyu Skewers ($198)** + **Pad Thai ($158)**.
    *   Total: 356.
    *   Add Roti ($58) + Rice ($30) = 444.
    *   Add Dessert ($88) = 532.
    *   This is a bit high.

Let's stick to the **Set 1 (Balanced Classic)** as the main rec because it fits "budget-conscious" best while offering variety.
Then offer the **Wagyu option** as a "splurge" alternative.

**Dish breakdown for the final output:**
1.  **Starter:** Fresh Made Roti (58 HKD). It's cheap and sweet/savory.
2.  **Main 1:** Pad Thai (158 HKD). Classic, crispy noodles, tamarind.
3.  **Main 2:** Fried Rice with Crabmeat & Spring Onions (168 HKD). High protein, nice texture.
4.  **Side:** Thai Jasmine Rice (30 HKD). Essential carb.
5.  **Dessert:** Coconut Ice Cream (88 HKD). Classic Thai dessert, not too sweet compared to Mango Sticky Rice.

**Total Cost Estimate:** 58 + 158 + 168 + 30 + 88 = 502 HKD.
Plus 10% service charge = ~552 HKD.
This is actually quite reasonable for a nice dinner in HK. Is it "budget-conscious"?
Maybe swap the Crab Rice for the **Fried Rice with Chiltoen & Flat Noodles (148 HKD)**.
New Total: 58 + 158 + 148 + 30 + 88 = 482 HKD.
Plus service charge = ~530 HKD.
This is better.

**Alternative "Highlight" Rec:**
If they really want the Wagyu:
1.  **Char-grilled Wagyu Skewers (198)**.
2.  **Massaman Curry (258)**.
3.  **Fresh Roti (58)**.
4.  **Rice (30)**.
Total: 544 HKD.
This is basically the same price as the other option but with fancier food. I will present this as the "Indulgent" option.

**Final Plan:**
1.  Acknowledge the restaurant (Samson).
2.  Propose **Option 1: The Balanced & Value Pick** (Focus on variety).
3.  Propose **Option 2: The "Highlight" Meat Lover Pick** (Focus on the Wagyu).
4.  Provide a breakdown of costs including the 10% service charge.
5.  Give specific tips on ordering (e.g., sharing the skewers).

Let's double check the prices.
Skewers + Sides: 158, 148, 198, 58, 88, 30.
Curries: 168, 158, 258, 248, 238.
Wok: 168, 168, 158, 188, 148, 158, 178.
Sweet Roti: 78, 108.
Desserts: 98, 88, 88, 88, 88.

Okay, my calculations hold up.

One detail: "Fresh made Roti (Perfect with our curry)" is 58.
"Fresh made Roti with Nutella or condensed milk" is 78.
I'll recommend the plain one for the budget option, or the Nutella one if they want something sweeter.

Let's write the response.
</think>

Based on the menu from Samson, here are three recommended combinations for two people. They range from a balanced mix to a more indulgent "highlight" meal, all taking into account the 10% service charge mentioned at the bottom.

### Option 1: The Balanced & Value Pick (~$530 HKD total)
This is the best choice if you want variety and don't want to spend too much. It mixes a classic stir-fry, a rice dish, and a sweet side.

*   **Mains:**
    *   **Pad Thai (158 HKD):** A classic stir-fry with rice noodles, peanuts, and egg. It’s a crowd-pleaser.
    *   **Fried Rice with Crabmeat & Spring Onions (168 HKD):** A high-protein option that pairs well with the spicy Pad Thai.
*   **Sides/Starter:**
    *   **Fresh Made Roti (58 HKD):** A great, inexpensive starter that is described as "perfect with our curry." It comes with condensed milk.
    *   **Thai Jasmine Rice (30 HKD):** Essential for soaking up the sauces.
*   **Dessert:**
    *   **Coconut Ice Cream (88 HKD):** A refreshing finish that isn't overly sweet like the Mango Sticky Rice.

**Total before service charge:** 502 HKD | **Total with 10% service charge:** ~552 HKD

---

### Option 2: The "Highlight" Meat Lover (~$560 HKD total)
If you really want to try the "highlights" (the most expensive and premium items on the menu), this is your combo. The Wagyu beef is the star here.

*   **Mains:**
    *   **Char-grilled Wagyu M37 Beef Skewers (198 HKD):** This is the most expensive item. Since it's skewers, you can easily share the order between the two of you.
    *   **Massaman Curry (258 HKD):** A rich, creamy curry with beef cheeks and potatoes. It’s a very popular signature dish.
*   **Sides:**
    *   **Fresh Made Roti (58 HKD):** To balance out the richness of the curry and beef.
*   **Rice:**
    *   **Thai Jasmine Rice (30 HKD):**

**Total before service charge:** 544 HKD | **Total with 10% service charge:** ~598 HKD

---

### Option 3: The "Curious Diner" Budget Pick (~$350 HKD total)
If you want to save money and try a different style of Thai food (Noodles vs. Rice).

*   **Main:**
    *   **Khao Soi (168 HKD):** This is a bowl of curry noodles with mustard greens and herbs. It’s a famous dish from Northern Thailand and very filling.
*   **Side:**
    *   **Fresh Made Roti (58 HKD)**
*   **Rice:**
    *   **Thai Jasmine Rice (30 HKD)**
*   **Dessert:**
    *   **Pandan Ice Cream (88 HKD)** (Or the Thai Red Tea Ice Cream)

**Total before service charge:** 344 HKD | **Total with 10% service charge:** ~378 HKD

**My Recommendation:**
Go with **Option 1**. It gives you a good mix of textures (crispy noodles, soft rice, fluffy roti) and keeps the budget under 600 HKD, which is reasonable for a nice dinner out. Just remember to ask for extra lime for the Pad Thai!

4. 显存优化：GGUF + VRAM Mode 双剑合璧

这是消费级显卡跑通的关键。官方提供了两个互补的特性：

(1) GGUF 量化权重

社区用户 @smthemex 维护了 Q3/Q4/Q5/Q6/Q8 多种量化：

uv pip install -e ".[gguf]"

python examples/t2i/inference.py \
  --model_path sensenova/SenseNova-U1.5-8B-MoT-Preview \
  --gguf_checkpoint /path/to/SenseNova-U1.5-8B-MoT-Preview-Q8.gguf \
  --prompt "A male peacock trying to attract a female" \
  --output output_gguf.png

(2) --vram_mode 分层卸载

模式	行为	适用显存
full	整模放 GPU，最快	≥24GB
fast	异步预取，生成层常驻 GPU	24GB 级别
balanced	异步预取重叠 H2D 拷贝与计算	显存紧张但想保速度
low	同步逐层 CPU↔GPU 交换，最省显存	最低

举个 12GB RTX 3060 上的实战命令：

python examples/t2i/inference.py \
  --model_path sensenova/SenseNova-U1-8B-MoT \
  --gguf_checkpoint ./checkpoints/SenseNova-U1-8B-MoT-8step-Q4_K_S.gguf \
  --vram_mode low \
  --prompt "A male peacock trying to attract a female" \
  --width 2048 --height 2048 \
  --cfg_scale 1.0 --cfg_norm none --timestep_shift 3.0 \
  --num_steps 8 \
  --output output.png

5. 生产部署：LightLLM + LightX2V 解耦架构

SenseNova-U1 对外是一个统一模型，但理解和生成的推理特性截然不同——前者是多模态 prefill + 自回归解码，后者是迭代式像素空间去噪。因此官方推荐解耦部署：

• LightLLM 负责理解分支：LLM 向的 Tensor Parallelism
• LightX2V 负责生成分支：扩散向的 CFG Parallelism 或 Sequence Parallelism
• 两引擎通过锁页共享内存和优化的传输 kernel 交换状态

---

五、踩坑与实践建议

把官方文档和社区反馈揉在一起，给开发者几点实在的建议：

新手最简路线

1. 先去 SenseNova-Studio 网页版 体验，确认效果符合预期
2. 有 24G 及以上显卡 → 直接 balanced 模式跑 t2i_demo.py，验证环境
3. 跑通后再试图像编辑、图文交错
4. 显存≤12G → 上 GGUF 量化

几个常见坑

• OOM：务必加 --vram_mode；不要一上来就开 4K；关闭其他占显存程序
• HF 下载超时：提前配置镜像，或手动下载到本地用 --model_path 指向本地文件夹
• Mac / AMD 显卡：本机可以搭环境，但 MPS 推理即便是 512×512 最小测试也会 OOM，不建议硬跑；直接用网页版
• 原生 Windows：不推荐，问题很多；用 WSL2
• 内存底线：至少 32GB 系统内存，最好 64GB；低显存显卡会大量占用内存交换，内存太小会巨慢甚至卡死

显卡选购参考

• RTX 4090 / 3090（24G）：原版 balanced，2K 流畅；不要 4K；想要更快就上 8 步 LoRA
• RTX 4080 / 3080（16G）：GGUF Q8 + balanced，2K 正常玩
• RTX 4070Ti / 3060（12G）：GGUF Q6/Q4 + low/balanced，分辨率控制在 ≤1792
• 8GB 笔记本显卡：只能 GGUF Q4 小图玩玩，别指望 4K 和图文交错

---

六、总结

SenseNova-U1 不只是又一个开源多模态模型。它验证了一个架构假设：去掉 VE 和 VAE，直接在像素-词元空间做端到端统一，是可行且高效的。

技术报告里的消融实验给出了三个关键结论：

• 无编码器设计能同时保留语义和像素表征（COCO 重建 PSNR 31.56）
• 原生 MoT 让理解和生成协同进化，本质冲突极小
• 原生多模态架构展现出极高的数据规模化效率

如果这条路线在更多工作中被复现和验证，未来的多模态架构会简化很多——一个模型、一套权重、一次推理，覆盖理解、生成、编辑的完整闭环。目前图文交错生成仍是 beta 特性，效果还没达到独立文生图流水线的水平；图像内部文字偶尔有畸变。但这些局限不妨碍它成为当前开源界原生统一多模态最完整的实践样本。

对开发者来说，现在正是上手的好时机：网页版零门槛试用 → 消费卡 GGUF 量化跑通 → 生产环境 LightLLM + LightX2V 解耦部署，整条路径都已经打通。从拼接集成到原生统一，多模态 AI 的范式切换，已经开始了。