graphics.html 19 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392
  1. <!doctype html>
  2. <html lang="en">
  3. <head>
  4. <meta charset="utf-8">
  5. <meta name="viewport" content="width=device-width, initial-scale=1">
  6. <title>Graphics &amp; UI | NebOS Architecture</title>
  7. <meta name="description" content="NebOS graphics architecture: VBE framebuffer, shadow buffer, damage rectangles, blit vtable, window manager, canvas ABI, ngui toolkit and image library.">
  8. <link rel="icon" href="favicon.svg" type="image/svg+xml">
  9. <link rel="stylesheet" href="style.css">
  10. </head>
  11. <body>
  12. <a class="skip" href="#main">Skip to content</a>
  13. <header class="site-header">
  14. <a class="brand" href="index.html">
  15. <span class="brand-mark" aria-hidden="true"></span>
  16. <span>NebOS <span class="brand-sub">Architecture</span></span>
  17. </a>
  18. <nav class="site-nav" aria-label="Architecture sections">
  19. <a href="index.html">Overview</a>
  20. <a href="boot.html">Boot</a>
  21. <a href="memory.html">Memory</a>
  22. <a href="cpu.html">CPU</a>
  23. <a href="drivers.html">Drivers</a>
  24. <a href="filesystems.html">Filesystems</a>
  25. <a href="graphics.html" aria-current="page">Graphics</a>
  26. <a href="network.html">Network</a>
  27. <a href="userland.html">Userland</a>
  28. <a href="development.html">Development</a>
  29. </nav>
  30. </header>
  31. <main id="main" class="page">
  32. <div class="page-head">
  33. <p class="kicker">Graphics &amp; UI</p>
  34. <h1>Draw into a shadow, publish by damage.</h1>
  35. <p class="lede">
  36. The display path is intentionally simple: drawing lands in a RAM
  37. shadow buffer, damage rectangles describe what changed, and a
  38. budgeted flush copies those rectangles to VRAM. Windows add a
  39. compositor and a mapped-canvas ABI on top; a small immediate-mode
  40. toolkit supplies the widgets.
  41. </p>
  42. <div class="meta">
  43. <span class="pill">VBE LFB</span>
  44. <span class="pill">1 MiB flush budget</span>
  45. <span class="pill">8 windows</span>
  46. <span class="pill">RGB565 canvases</span>
  47. </div>
  48. </div>
  49. <nav class="toc" aria-label="On this page">
  50. <h2>On this page</h2>
  51. <ul>
  52. <li><a href="#framebuffer">Framebuffer</a></li>
  53. <li><a href="#shadow">Shadow &amp; damage</a></li>
  54. <li><a href="#blit">Blit backends</a></li>
  55. <li><a href="#wm">Window manager</a></li>
  56. <li><a href="#canvas">Canvas ABI</a></li>
  57. <li><a href="#ngui">ngui toolkit</a></li>
  58. <li><a href="#apps">Applications</a></li>
  59. <li><a href="#images">Image library</a></li>
  60. <li><a href="#gpu">GPU quirks</a></li>
  61. <li><a href="#sources">Source map</a></li>
  62. </ul>
  63. </nav>
  64. <section id="framebuffer">
  65. <h2>Framebuffer</h2>
  66. <p>
  67. The boot path writes a <code>struct vga_boot_fb_info</code> to
  68. <code>0x600</code>: LFB base, pitch, width, height, bits per pixel
  69. and an RGBX flag for GOP's byte order. The legacy VESA stage chooses
  70. a mode with at least 16 bpp, a linear framebuffer, it must fit the
  71. card's VRAM, and width at most 1280 pixels. The UEFI loader imposes
  72. its own GOP constraints.
  73. </p>
  74. <p>
  75. <span class="file">vga.c</span> owns the visible surface. On a
  76. normal boot the render target is a RAM shadow buffer at
  77. <code>0x100000</code>, not the LFB; the 8 MB reserve leaves room for
  78. future modes. A surface carries width, height, pitch, format and a
  79. pixel-pointer, so the same drawing code can target a window layer or
  80. a canvas.
  81. </p>
  82. </section>
  83. <section id="shadow">
  84. <h2>Shadow buffer &amp; damage</h2>
  85. <p>
  86. Drawing never writes VRAM directly. Each operation records a damage
  87. rectangle; overlapping or touching rectangles merge, so a keystroke's
  88. cells collapse into one small rect while unrelated damage stays
  89. apart. The main loop calls <code>vga_present_shadow()</code> on every
  90. iteration with a byte budget of <code>VGA_FLUSH_BUDGET_BYTES</code>
  91. (1 MiB by default).
  92. </p>
  93. <ul>
  94. <li><strong>Small rects copy whole.</strong> A window repaint within the budget never tears.</li>
  95. <li><strong>Large rects are chunked.</strong> A full-screen redraw continues across loop iterations; newer damage is queued behind it.</li>
  96. <li><strong>No fixed frame rate.</strong> The loop flushes whenever there is pending damage, so a cursor move reaches the screen within one loop.</li>
  97. <li><strong>Re-entry guard.</strong> <code>vga_present_shadow()</code> refuses to run while another process is mid-flush; a full-screen copy is long enough to be preempted.</li>
  98. <li><strong>Window drags flush immediately.</strong> <code>wm_drag_shadow</code> copies each drag step as one consistent frame.</li>
  99. </ul>
  100. <p>
  101. When the target is not the screen — a window layer or an app canvas —
  102. <code>vga_target_damage()</code> is a no-op. The render target
  103. override is stored in the PCB, so a preempted draw cannot leak into
  104. another process's window.
  105. </p>
  106. </section>
  107. <section id="blit">
  108. <h2>Blit backends</h2>
  109. <p>
  110. <span class="file">blit.c</span> is the pixel-operation vtable:
  111. fill, copy, blend, canvas, present and flip. Software is the only
  112. backend today, but the WM calls the vtable rather than a fixed
  113. function, so an accelerator can replace individual operations
  114. without touching window logic.
  115. </p>
  116. <p>
  117. The software fill uses an SSE2 row store when the CPU supports it.
  118. Rows that do not fit the cache use streaming stores
  119. (<code>movntdq</code>, one <code>sfence</code> per fill), which
  120. avoids read-for-ownership traffic that makes large fills DRAM-bound
  121. on the Atom. SSE/SSE2 are never assumed: the kernel is built with
  122. <code>-mno-sse</code>, and <code>cpu_has_sse2()</code> probes CPUID,
  123. sets <code>CR4.OSFXSR/OSXMMEXCPT</code> and is re-run on every AP.
  124. </p>
  125. <p>
  126. <code>gfxbench</code> times fill, copy, cell, canvas and flush paths
  127. and reports the bytes actually copied by the presenter.
  128. </p>
  129. </section>
  130. <section id="wm">
  131. <h2>Window manager</h2>
  132. <p>
  133. The WM is a process that owns the desktop and a fixed array of eight
  134. windows. It draws a system bar with the banner, launcher buttons,
  135. clock, the CPU temperature and, on ThinkPads, the AC adapter state
  136. and battery percentage, plus draggable
  137. terminal and canvas windows with a title bar and close button.
  138. Click-to-focus, drag-by-title-bar and close are routed through the
  139. same pointer path. The right-aligned date/time text is also a
  140. target: it highlights on hover and opens the Date &amp; Time editor
  141. (<code>bin/settime</code>) on a click.
  142. </p>
  143. <p>
  144. The WM is the ring-3 process loaded from
  145. <code>/ramfs/bin/wm</code>; there is no kernel WM fallback. The
  146. kernel window server in <span class="file">wm.c</span> owns the
  147. shadow mapping, the per-window canvases, input routing, the cursor,
  148. kexec detection and the boot-console handoff. It starts the first
  149. terminal after the storage mount
  150. (<code>wm_server_boot_ready</code>) and leaves the boot console
  151. visible until the WM attaches.
  152. </p>
  153. <figure class="figure">
  154. <svg viewBox="0 0 920 260" role="img" aria-labelledby="wm-title wm-desc">
  155. <title id="wm-title">Window anatomy</title>
  156. <desc id="wm-desc">A window consists of a title bar, a content area backed by an RGB565 canvas, and a close control. The WM composites the canvas into the screen shadow buffer.</desc>
  157. <rect class="svg-box" x="70" y="22" width="780" height="200" rx="10"/>
  158. <rect class="svg-box accent" x="70" y="22" width="780" height="34" rx="10"/>
  159. <text class="svg-text" x="88" y="45">Terminal · /ramfs/bin/ls</text>
  160. <text class="svg-text" x="800" y="45">×</text>
  161. <rect class="svg-box green" x="86" y="72" width="748" height="132" rx="6"/>
  162. <text class="svg-text" x="104" y="98">content canvas · RGB565 · mapped at 0x50000000</text>
  163. <text class="svg-sub" x="104" y="120">text cells, images, widgets, or arbitrary drawing</text>
  164. </svg>
  165. <figcaption>
  166. <strong>One window, one canvas.</strong> The title bar belongs to
  167. the WM; the content is whatever the owning process draws into its
  168. mapped back buffer. The WM never reads the process's memory — it
  169. composites the front canvas on <code>PRESENT</code>.
  170. </figcaption>
  171. </figure>
  172. <ul>
  173. <li><strong>Terminal windows</strong> are canvas clients: <span class="file">ucmd_term.c</span> renders its rows into the RGB565 window canvas; keys arrive through the generic <code>SYS_KEY_POLL</code> or <code>SYS_WIN_KEY_WAIT</code>. The WM no longer has a text-cell path.</li>
  174. <li><strong>Canvas windows</strong> are generic: the app gets a back buffer, pointer position/buttons/focus and queued press/release edges with capture.</li>
  175. <li><strong>Focus and z-order</strong> are explicit; closing a window kills its session and frees its canvas.</li>
  176. </ul>
  177. <h3>Compositing cost</h3>
  178. <p>
  179. The WM keeps a front-to-back order: the focused window first, then
  180. the remaining windows in descending slot order. For each damage
  181. rectangle it fills the desktop once and walks that order, subtracting
  182. every window in front from the region still uncovered. A window is
  183. drawn only in its exposed pieces, so a fully occluded window costs
  184. nothing and the stack is never repainted back-to-front. The kernel
  185. pointer hit-test uses the same order. A focused-window drag copies
  186. its shadow block to the new position and repaints only the old
  187. strips the new rectangle does not cover, instead of compositing the
  188. window at both positions. If either rectangle is partly off-screen
  189. the shadow has no valid pixels for the hidden part, so that step
  190. repaints the window rect instead of copying desktop background into
  191. it.
  192. </p>
  193. <p>
  194. <code>SYS_WIN_PRESENT</code> carries a content-relative damage
  195. rectangle. The terminal tracks its dirty rows, so a keystroke copies
  196. and composites one 8×16 row block instead of the whole 512×512
  197. canvas. The kernel unions the rectangles between WM polls and
  198. <code>SYS_WM_INFO</code> returns that union; a present with
  199. <code>w == 0</code> or <code>h == 0</code> still means the whole
  200. canvas. The WM overwrites <code>/share/wmstats</code> every two
  201. seconds with the interval's frame count, compositing time, worst
  202. frame and pixels drawn (<code>usurf_pixels</code>), which is the
  203. on-target compositor measurement.
  204. </p>
  205. </section>
  206. <section id="canvas">
  207. <h2>Canvas ABI</h2>
  208. <p>
  209. <code>SYS_WIN_CREATE</code> maps the calling command's window canvas
  210. read/write at <code>0x50000000</code>. The process draws RGB565
  211. pixels and publishes a finished frame with
  212. <code>SYS_WIN_PRESENT</code>, optionally passing a content-relative
  213. rectangle (<code>struct wm_win_present</code>) for the changed
  214. region. Present copies that region from the back buffer into the
  215. composited front canvas with interrupts off, so a half-drawn frame
  216. can never reach the screen. Frames carry monotonic sequence
  217. counters, so the WM cannot lose one.
  218. </p>
  219. <p>
  220. <code>SYS_WIN_CREATE</code> creates a generic canvas window. Input is
  221. exposed through <code>SYS_WIN_POINTER</code> (content-relative
  222. position, button mask, focus) and <code>SYS_WIN_EVENT</code>, which
  223. queues press/release edges and a capture window. A click that starts
  224. in a window still receives its release after the pointer leaves.
  225. The WM process itself is special: it maps the screen shadow at
  226. <code>0x58000000</code> and each front canvas at
  227. <code>0x59000000 + index × 4 MB</code>, which is how it composites
  228. without reading another process's memory. The 4 MB slot covers a
  229. full-screen 1280×1024 canvas minus the chrome; the old 2 MB slot
  230. capped a full-height window at roughly 1050 px wide.
  231. <code>SYS_WM_RESIZE</code> (WM side) and
  232. <code>SYS_WIN_ACK_RESIZE</code> (client side) swap in a resized
  233. canvas; the content size is bounded by the framebuffer, so a
  234. window can grow to the edge of the screen.
  235. </p>
  236. <p>
  237. Double-clicking a title bar maximizes the window to the work area
  238. below the system bar (<code>0, WM_BAR_H, fbw, fbh - WM_BAR_H</code>);
  239. the next double-click restores the saved geometry. Dragging a
  240. maximized window restores it first, and a manual resize clears the
  241. maximized state. Windows can be dragged past the left, right and
  242. bottom edges; <code>WM_DRAG_VISIBLE</code> (48 px) of the title bar
  243. always stays on-screen for recovery, and the top bar is never
  244. overlapped. The resize grip is clamped to the full work area and
  245. snaps to it when dragged into the screen corner.
  246. </p>
  247. <div class="note">
  248. <p><strong>Buttons fire on the release edge.</strong> The toolkit keeps
  249. a button <code>active</code> until <code>ui-&gt;released</code>;
  250. inferring release from the sampled button mask races the WM event
  251. queue and drops clicks.</p>
  252. </div>
  253. <p>
  254. When a process exits or crashes, the reaper releases its window
  255. mappings and the window server frees the canvas. Closing a window
  256. kills its owner. Keys go through the window key queue
  257. (<code>SYS_WIN_KEY_WAIT</code>) or the generic
  258. <code>SYS_KEY_POLL</code>; Ctrl+C still reaches the terminal.
  259. </p>
  260. </section>
  261. <section id="ngui">
  262. <h2>ngui toolkit</h2>
  263. <p>
  264. <span class="file">ngui.c</span>/<span class="file">ngui.h</span> is an
  265. immediate-mode GUI toolkit shared by the ring-3 apps. It provides
  266. clipped RGB565 primitives, buttons, menu items, text fields, nine
  267. procedural icons, a theme palette, layout cut helpers and scrolling
  268. panes. It is linked into <code>files</code>, <code>mines</code>,
  269. <code>solitaire</code> and the real <code>gallery.elf</code>.
  270. </p>
  271. <ul>
  272. <li><strong>Text fields</strong> support drag-selection, double-click select-all, Ctrl+Left/Right word jumps, Ctrl+Delete/Backspace word deletion and Ctrl+A. They use the proportional face with measured caret, selection and horizontal scrolling; a field marked <code>disabled</code> ignores pointer and keyboard input, drops the focus and paints its value dimmed in the same proportional face. The terminal and editor keep the 8×16 cell grid.</li>
  273. <li><strong>Clip stack</strong> keeps nested panes and popups inside their parents.</li>
  274. <li><strong>Layout cuts</strong> split a rectangle into rows, columns and fixed margins without a constraint solver.</li>
  275. <li><strong>No retained widget tree.</strong> Apps redraw from state every frame, which keeps the toolkit small and predictable.</li>
  276. </ul>
  277. <p>
  278. Proportional text comes from <span class="file">ufont.c</span>: a
  279. fixed-point, integer-only TrueType parser and antialiased rasterizer.
  280. The pack carries Latin-1 Arimo regular/bold/italic/bold-italic and
  281. Liberation Mono subsets under <code>/ramfs/fonts</code>. The browser,
  282. ngui apps and the WM chrome use real pixel sizes from 8 to 48 px;
  283. the browser maps CSS <code>font-size</code>, <code>font-weight</code>,
  284. <code>font-style</code> and <code>font-family: monospace</code> to
  285. the faces. Missing fonts fall back to the 8×16 bitmap. The browser
  286. detaches the font arena before <code>heap_reset()</code> and
  287. reattaches after <code>heap_start()</code>; terminal content and
  288. the editor keep the bitmap cells.
  289. </p>
  290. </section>
  291. <section id="apps">
  292. <h2>Applications</h2>
  293. <div class="grid">
  294. <div class="card">
  295. <h3>files</h3>
  296. <p>File browser on the VFS: opens text in <code>edit</code>, images in <code>view</code> and HTML in <code>browser</code>. The first ngui user.</p>
  297. </div>
  298. <div class="card">
  299. <h3>gallery</h3>
  300. <p>Live showcase of every ngui control and primitive. Ships in the pack as <code>bin/gallery.app</code>; a launcher prefers <code>/share/GALLERY</code> for development.</p>
  301. </div>
  302. <div class="card">
  303. <h3>solitaire</h3>
  304. <p>Klondike with drag-and-drop, draw-one/three, scoring, animation and pixel-art cards on the canvas service.</p>
  305. </div>
  306. <div class="card">
  307. <h3>view</h3>
  308. <p>Image viewer with fit, 1:1, zoom, pan, EXIF orientation and animated GIF playback.</p>
  309. </div>
  310. <div class="card">
  311. <h3>clock / colors / settime</h3>
  312. <p>Small canvas demos: an analog clock, a colour test window, and the Date &amp; Time editor. Clicking the top-bar date/time opens <code>settime</code>, which reads and writes the CMOS RTC.</p>
  313. </div>
  314. <div class="card">
  315. <h3>browser</h3>
  316. <p>HTML/CSS renderer with flex rows, auto-fit card grids, inline-block runs, basic tables and inline SVG diagrams. It decodes inline images and fetches through a headless helper; inline and external scripts run on the vendored MuJS engine, while form submission is not supported. The largest ring-3 application in the tree.</p>
  317. </div>
  318. </div>
  319. </section>
  320. <section id="images">
  321. <h2>Image library</h2>
  322. <p>
  323. The codecs are independent of the OS and the toolkit: each takes an
  324. input buffer plus a caller-provided <code>struct img_mem</code> arena
  325. and returns an RGB565 image with an optional 8-bit alpha plane. The
  326. browser links the same objects and decodes HTTP bodies in memory.
  327. </p>
  328. <ul>
  329. <li><strong>Formats.</strong> PNG, baseline and progressive JPEG, animated GIF, BMP, TGA, PNM, ICO/CUR and PAM.</li>
  330. <li><strong>Drawing.</strong> <code>img_draw()</code> is a clipped, scaled RGB565 blit: box-filter downscale, bilinear upscale, alpha over a checkerboard or over the destination.</li>
  331. <li><strong>Orientation.</strong> EXIF orientation is applied; arithmetic JPEG and CMYK are rejected.</li>
  332. <li><strong>Cost.</strong> Downscaling runs on the CPU. The viewer caches one image; the browser keeps a display bitmap but still rescales on repaint.</li>
  333. </ul>
  334. </section>
  335. <section id="gpu">
  336. <h2>GPU quirks</h2>
  337. <ul>
  338. <li><strong>ATI Mach64.</strong> A CRTC fixup is applied after mode set. The legacy CRTC is skipped under UEFI.</li>
  339. <li><strong>NVIDIA.</strong> VBE-only. The legacy VGA CRTC is never touched. On the ION, the framebuffer is stolen DRAM behind a BAR3 aperture; <span class="file">nvidia.c</span> finds the stolen range and writes through a cached alias once a WC MTRR covers it.</li>
  340. <li><strong>Intel.</strong> The Ironlake-era path supports a hardware cursor where available; the software cursor is the common fallback.</li>
  341. <li><strong>UEFI.</strong> <code>vga.c</code> honours the RGBX flag and skips the VBE-only ATI CRTC reset and NVIDIA stolen-VRAM alias. <span class="file">mouse.c</span> forces the software cursor.</li>
  342. </ul>
  343. </section>
  344. <section id="sources">
  345. <h2>Source map</h2>
  346. <ul class="filelist">
  347. <li><code>vga.c</code>, <code>vga.h</code> — framebuffer and damage</li>
  348. <li><code>vga_copy.S</code> — copy primitives</li>
  349. <li><code>blit.c</code>, <code>blit.h</code> — pixel vtable</li>
  350. <li><code>cpu.c</code> — SSE2 probing</li>
  351. <li><code>wm.c</code>, <code>wm.h</code>, <code>wm_abi.h</code> — kernel window server and shared ABI</li>
  352. <li><code>ucmd_wm.c</code>, <code>uwm_lib.c</code> — ring-3 WM</li>
  353. <li><code>ucmd_settime.c</code>, <code>rtc.c</code> — Date &amp; Time editor and RTC access</li>
  354. <li><code>gfx.c</code>, <code>gfx.h</code> — RGB565 window canvases</li>
  355. <li><code>sys_wm.c</code>, <code>sys_wm.h</code> — WM/window ABI</li>
  356. <li><code>browser.c</code>, <code>browser_html.c</code> — HTML/CSS renderer and inline SVG</li>
  357. <li><code>ngui.c</code>, <code>ngui.h</code> — toolkit</li>
  358. <li><code>ufont.c</code>, <code>ufont_ttf.c</code>, <code>ufont_draw.c</code> — fixed-point TrueType text</li>
  359. <li><code>fonts/*.ttf</code> — Arimo / Liberation Mono subsets in the pack</li>
  360. <li><code>ucmd_files.c</code>, <code>gallery.c</code>, <code>ucmd_solitaire.c</code></li>
  361. <li><code>img*.c</code> — image codecs</li>
  362. <li><code>ati.c</code>, <code>nvidia.c</code>, <code>intel.c</code>, <code>nv50.c</code></li>
  363. </ul>
  364. </section>
  365. </main>
  366. <footer class="site-footer">
  367. <div class="inner">
  368. <p><strong>NebOS 0.2.0</strong> · Architecture documentation · <a href="index.html">overview</a></p>
  369. <p>Maintain alongside <code>AGENTS.md</code> and the source files listed on each page.</p>
  370. </div>
  371. </footer>
  372. </body>
  373. </html>