graphics.html 40 KB

123456789101112131415161718192021222324252627282930313233343536373839404142434445464748495051525354555657585960616263646566676869707172737475767778798081828384858687888990919293949596979899100101102103104105106107108109110111112113114115116117118119120121122123124125126127128129130131132133134135136137138139140141142143144145146147148149150151152153154155156157158159160161162163164165166167168169170171172173174175176177178179180181182183184185186187188189190191192193194195196197198199200201202203204205206207208209210211212213214215216217218219220221222223224225226227228229230231232233234235236237238239240241242243244245246247248249250251252253254255256257258259260261262263264265266267268269270271272273274275276277278279280281282283284285286287288289290291292293294295296297298299300301302303304305306307308309310311312313314315316317318319320321322323324325326327328329330331332333334335336337338339340341342343344345346347348349350351352353354355356357358359360361362363364365366367368369370371372373374375376377378379380381382383384385386387388389390391392393394395396397398399400401402403404405406407408409410411412413414415416417418419420421422423424425426427428429430431432433434435436437438439440441442443444445446447448449450451452453454455456457458459460461462463464465466467468469470471472473474475476477478479480481482483484485486487488489490491492493494495496497498499500501502503504505506507508509510511512513514515516517518519520521522523524525526527528529530531532533534535536537538539540541542543544545546547548549550551552553554555556557558559560561562563564565566567568569570571572573574575576577578579580581582583584585586
  1. <!doctype html>
  2. <html lang="en">
  3. <head>
  4. <meta charset="utf-8">
  5. <meta name="viewport" content="width=device-width, initial-scale=1">
  6. <title>Graphics &amp; UI | NebOS Architecture</title>
  7. <meta name="description" content="NebOS graphics architecture: VBE framebuffer, shadow buffer, damage rectangles, blit vtable, window manager, canvas ABI, ngui toolkit and image library.">
  8. <link rel="icon" href="favicon.svg" type="image/svg+xml">
  9. <link rel="stylesheet" href="style.css">
  10. </head>
  11. <body>
  12. <a class="skip" href="#main">Skip to content</a>
  13. <header class="site-header">
  14. <a class="brand" href="index.html">
  15. <span class="brand-mark" aria-hidden="true"></span>
  16. <span>NebOS <span class="brand-sub">Architecture</span></span>
  17. </a>
  18. <nav class="site-nav" aria-label="Architecture sections">
  19. <a href="index.html">Overview</a>
  20. <a href="boot.html">Boot</a>
  21. <a href="memory.html">Memory</a>
  22. <a href="cpu.html">CPU</a>
  23. <a href="drivers.html">Drivers</a>
  24. <a href="filesystems.html">Filesystems</a>
  25. <a href="graphics.html" aria-current="page">Graphics</a>
  26. <a href="network.html">Network</a>
  27. <a href="userland.html">Userland</a>
  28. <a href="development.html">Development</a>
  29. </nav>
  30. </header>
  31. <main id="main" class="page">
  32. <div class="page-head">
  33. <p class="kicker">Graphics &amp; UI</p>
  34. <h1>Draw into a shadow, publish by damage.</h1>
  35. <p class="lede">
  36. The display path is intentionally simple: drawing lands in a RAM
  37. shadow buffer, damage rectangles describe what changed, and a
  38. budgeted flush copies those rectangles to VRAM. Windows add a
  39. compositor and a mapped-canvas ABI on top; a small immediate-mode
  40. toolkit supplies the widgets.
  41. </p>
  42. <div class="meta">
  43. <span class="pill">VBE LFB</span>
  44. <span class="pill">1 MiB flush budget</span>
  45. <span class="pill">8 windows</span>
  46. <span class="pill">RGB565 canvases</span>
  47. </div>
  48. </div>
  49. <nav class="toc" aria-label="On this page">
  50. <h2>On this page</h2>
  51. <ul>
  52. <li><a href="#framebuffer">Framebuffer</a></li>
  53. <li><a href="#shadow">Shadow &amp; damage</a></li>
  54. <li><a href="#blit">Blit backends</a></li>
  55. <li><a href="#wm">Window manager</a></li>
  56. <li><a href="#canvas">Canvas ABI</a></li>
  57. <li><a href="#ngui">ngui toolkit</a></li>
  58. <li><a href="#apps">Applications</a></li>
  59. <li><a href="#images">Image library</a></li>
  60. <li><a href="#icons">UI icons</a></li>
  61. <li><a href="#cursors">Mouse cursors</a></li>
  62. <li><a href="#gpu">GPU quirks</a></li>
  63. <li><a href="#backlight">Panel backlight</a></li>
  64. <li><a href="#sources">Source map</a></li>
  65. </ul>
  66. </nav>
  67. <section id="framebuffer">
  68. <h2>Framebuffer</h2>
  69. <p>
  70. The boot path writes a <code>struct vga_boot_fb_info</code> to
  71. <code>0x600</code>: LFB base, pitch, width, height, bits per pixel
  72. and an RGBX flag for GOP's byte order. The legacy VESA stage chooses
  73. a mode with at least 16 bpp, a linear framebuffer, it must fit the
  74. card's VRAM, at most 1920 pixels wide, and its shadow (pitch ×
  75. height) must fit the 8 MB reserve. 1920×1080 is the practical
  76. maximum: its 8.29 MB shadow fits, and its 4.15 MB RGB565 canvas
  77. fits the 4 MB window slot; 1920×1200 is rejected because its
  78. canvas would need 4.6 MB. The UEFI loader applies the same GOP
  79. limits.
  80. </p>
  81. <p>
  82. <span class="file">vga.c</span> owns the visible surface. On a
  83. normal boot the render target is a RAM shadow buffer at
  84. <code>0x100000</code>, not the LFB; the 8 MB reserve holds a
  85. 1920×1080×32 frame (8.29 MB) with about 94 KB to spare. A surface
  86. carries width, height, pitch, format and a
  87. pixel-pointer, so the same drawing code can target a window layer or
  88. a canvas.
  89. </p>
  90. </section>
  91. <section id="shadow">
  92. <h2>Shadow buffer &amp; damage</h2>
  93. <p>
  94. Drawing never writes VRAM directly. Each operation records a damage
  95. rectangle; overlapping or touching rectangles merge, so a keystroke's
  96. cells collapse into one small rect while unrelated damage stays
  97. apart. The main loop calls <code>vga_present_shadow()</code> on every
  98. iteration with a byte budget of <code>VGA_FLUSH_BUDGET_BYTES</code>
  99. (1 MiB by default).
  100. </p>
  101. <ul>
  102. <li><strong>Small rects copy whole.</strong> A window repaint within the budget never tears.</li>
  103. <li><strong>Large rects are chunked.</strong> A full-screen redraw continues across loop iterations; newer damage is queued behind it.</li>
  104. <li><strong>No fixed frame rate.</strong> The loop flushes whenever there is pending damage, so a cursor move reaches the screen within one loop.</li>
  105. <li><strong>Re-entry guard.</strong> <code>vga_present_shadow()</code> refuses to run while another process is mid-flush; a full-screen copy is long enough to be preempted.</li>
  106. <li><strong>Window drags flush immediately.</strong> <code>wm_drag_shadow</code> copies each drag step as one consistent frame.</li>
  107. </ul>
  108. <p>
  109. When the target is not the screen — a window layer or an app canvas —
  110. <code>vga_target_damage()</code> is a no-op. The render target
  111. override is stored in the PCB, so a preempted draw cannot leak into
  112. another process's window.
  113. </p>
  114. </section>
  115. <section id="blit">
  116. <h2>Blit backends</h2>
  117. <p>
  118. <span class="file">blit.c</span> is the pixel-operation vtable:
  119. fill, copy, blend, canvas, present and flip. Software is the only
  120. backend today, but the WM calls the vtable rather than a fixed
  121. function, so an accelerator can replace individual operations
  122. without touching window logic.
  123. </p>
  124. <p>
  125. The software fill uses an SSE2 row store when the CPU supports it.
  126. Rows that do not fit the cache use streaming stores
  127. (<code>movntdq</code>, one <code>sfence</code> per fill), which
  128. avoids read-for-ownership traffic that makes large fills DRAM-bound
  129. on the Atom. SSE/SSE2 are never assumed: the kernel is built with
  130. <code>-mno-sse</code>, and <code>cpu_has_sse2()</code> probes CPUID,
  131. sets <code>CR4.OSFXSR/OSXMMEXCPT</code> and is re-run on every AP.
  132. </p>
  133. <p>
  134. <code>gfxbench</code> times fill, copy, cell, canvas and flush paths
  135. and reports the bytes actually copied by the presenter.
  136. </p>
  137. </section>
  138. <section id="wm">
  139. <h2>Window manager</h2>
  140. <p>
  141. The WM is a process that owns the desktop and a fixed array of eight
  142. windows. It draws a system bar with the banner, launcher buttons,
  143. clock, the temperature, and, on ThinkPads and Chromebooks, an
  144. AC/battery status icon at the far right (the Adwaita
  145. <code>ac-adapter</code> symbol on AC, and the <code>battery</code>
  146. outline with our own level fill inside on battery, with a
  147. percentage tooltip below the bar on hover, painted above the
  148. windows), plus draggable
  149. terminal and canvas windows with a title bar and close button.
  150. A normal window has no visible frame; an invisible resize band
  151. (1 px inside, 3 px outside its outer edge) is the resize grab
  152. area, and the active title bar uses the toolkit's highlight
  153. colour.
  154. Click-to-focus, drag-by-title-bar and close are routed through the
  155. same pointer path. To the left of the rightmost AC/battery status
  156. icon, a network status icon shows the Adwaita
  157. <code>network-wired</code> symbol for wired Ethernet, a
  158. <code>network-wireless-signal-*</code> symbol for a connected WiFi
  159. link, the <code>phone</code> symbol for RNDIS tethering, and
  160. <code>network-wired-disconnected</code> in red when no NIC is
  161. active (<code>network-wireless-offline</code> when a WiFi card is
  162. present but not associated).
  163. The whole right status area — temperature, date/time, network
  164. and AC/battery items plus the gaps between them — is one button:
  165. it opens the anchored <code>bin/netmenu</code> control panel (a
  166. second click closes it).
  167. It opens collapsed: the battery/clock summary and Quick settings
  168. pills are visible, while the network, power-mode and date/time
  169. settings stay hidden until their pill is clicked. Present NICs
  170. can then be selected (DHCP runs), and scanned WiFi networks can be
  171. joined, asking for the WPA2 passphrase first when the AP requires
  172. one.
  173. </p>
  174. <p>
  175. A popover is a chromeless canvas window created with
  176. <code>u_win_create_popover()</code> (<code>WIN_F_POPOVER</code>).
  177. The WM anchors it flush under the top bar at the right screen
  178. edge, treats it as always topmost in painting and hit-testing,
  179. and draws no chrome at all:
  180. the canvas fills the whole window rectangle, with no title bar,
  181. shadow, rim or rounded outer corners, so it reads as a flat menu
  182. panel. The kernel uses the window origin for content-relative
  183. pointer and scroll coordinates. An outside press dismisses the
  184. popover and the click then continues normally; a second click on
  185. any status target toggles it. The panel itself is drawn with the
  186. ngui components: a battery/AC and clock summary, a brightness
  187. slider when the panel PWM is present, and Quick settings tiles for
  188. Network, the CPU power mode (<code>SYS_CPUFREQ</code>) and Date
  189. &amp; Time. Clicking a tile expands that section in place — the
  190. network devices/Wi-Fi/connection lists, the three power modes, or
  191. an inline date/time editor with Set, Now and Sync NTP (no separate
  192. window). <code>SYS_WIN_RESIZE_SELF</code> grows or shrinks the
  193. popover to the section, clamped to <code>SYS_SCREEN_INFO</code>'s
  194. framebuffer; the section scrolls with the wheel, touchpad or page
  195. keys when it is taller than the screen, and its overlay scrollbar
  196. slides in while the pointer is over the panel.
  197. </p>
  198. <p>
  199. The WM is the ring-3 process loaded from
  200. <code>/ramfs/bin/wm</code>; there is no kernel WM fallback. The
  201. kernel window server in <span class="file">wm.c</span> owns the
  202. shadow mapping, the per-window canvases, input routing, the cursor,
  203. kexec detection and the boot-console handoff. It starts the first
  204. terminal after the storage mount
  205. (<code>wm_server_boot_ready</code>) and leaves the boot console
  206. visible until the WM attaches. The console uses the same 8×16 face
  207. and top-left origin as the terminal, so the first frame replaces it
  208. without a size or position jump.
  209. </p>
  210. <figure class="figure">
  211. <svg viewBox="0 0 920 260" role="img" aria-labelledby="wm-title wm-desc">
  212. <title id="wm-title">Window anatomy</title>
  213. <desc id="wm-desc">A window consists of a title bar, a content area backed by an RGB565 canvas, and a close control. The WM composites the canvas into the screen shadow buffer.</desc>
  214. <rect class="svg-box" x="70" y="22" width="780" height="200" rx="10"/>
  215. <rect class="svg-box accent" x="70" y="22" width="780" height="34" rx="10"/>
  216. <text class="svg-text" x="88" y="45">Terminal · /ramfs/bin/ls</text>
  217. <text class="svg-text" x="800" y="45">×</text>
  218. <rect class="svg-box green" x="86" y="72" width="748" height="132" rx="6"/>
  219. <text class="svg-text" x="104" y="98">content canvas · RGB565 · mapped at 0x50000000</text>
  220. <text class="svg-sub" x="104" y="120">text cells, images, widgets, or arbitrary drawing</text>
  221. </svg>
  222. <figcaption>
  223. <strong>One window, one canvas.</strong> The title bar belongs to
  224. the WM; the content is whatever the owning process draws into its
  225. mapped back buffer. The WM never reads the process's memory — it
  226. composites the front canvas on <code>PRESENT</code>.
  227. </figcaption>
  228. </figure>
  229. <ul>
  230. <li><strong>Terminal windows</strong> are canvas clients: <span class="file">ucmd_term.c</span> renders its rows into the RGB565 window canvas; keys arrive through the generic <code>SYS_KEY_POLL</code> or <code>SYS_WIN_KEY_WAIT</code>. The WM no longer has a text-cell path.</li>
  231. <li><strong>Canvas windows</strong> are generic: the app gets a back buffer, pointer position/buttons/focus and queued press/release edges with capture.</li>
  232. <li><strong>Focus and z-order</strong> are explicit; closing a window kills its session and frees its canvas.</li>
  233. </ul>
  234. <h3>Compositing cost</h3>
  235. <p>
  236. The WM keeps a front-to-back order: the focused window first, then
  237. the remaining windows in descending slot order. For each damage
  238. rectangle it fills the desktop once and walks that order, subtracting
  239. every window in front from the region still uncovered. A window is
  240. drawn only in its exposed pieces, so a fully occluded window costs
  241. nothing and the stack is never repainted back-to-front. The kernel
  242. pointer hit-test uses the same order. A focused-window drag copies
  243. its shadow block to the new position and repaints only the old
  244. strips the new rectangle does not cover, instead of compositing the
  245. window at both positions. If either rectangle is partly off-screen
  246. the shadow has no valid pixels for the hidden part, so that step
  247. repaints the window rect instead of copying desktop background into
  248. it.
  249. </p>
  250. <p>
  251. <code>SYS_WIN_PRESENT</code> carries a content-relative damage
  252. rectangle. The terminal tracks its dirty rows, so a keystroke copies
  253. and composites one 8×16 row block instead of the whole 512×512
  254. canvas. The kernel unions the rectangles between WM polls and
  255. <code>SYS_WM_INFO</code> returns that union; a present with
  256. <code>w == 0</code> or <code>h == 0</code> still means the whole
  257. canvas. The WM overwrites <code>/share/wmstats</code> every two
  258. seconds with the interval's frame count, compositing time, worst
  259. frame and pixels drawn (<code>usurf_pixels</code>), which is the
  260. on-target compositor measurement.
  261. </p>
  262. </section>
  263. <section id="canvas">
  264. <h2>Canvas ABI</h2>
  265. <p>
  266. <code>SYS_WIN_CREATE</code> maps the calling command's window canvas
  267. read/write at <code>0x50000000</code>. The process draws RGB565
  268. pixels and publishes a finished frame with
  269. <code>SYS_WIN_PRESENT</code>, optionally passing a content-relative
  270. rectangle (<code>struct wm_win_present</code>) for the changed
  271. region. Present copies that region from the back buffer into the
  272. composited front canvas with interrupts off, so a half-drawn frame
  273. can never reach the screen. Frames carry monotonic sequence
  274. counters, so the WM cannot lose one. <code>content_gen</code> comes
  275. from a global counter and is unique per window creation, so a new
  276. window that reuses a just-closed slot forces the WM to remap its
  277. front canvas instead of reusing a stale mapping.
  278. </p>
  279. <p>
  280. <code>SYS_WIN_CREATE</code> creates a generic canvas window.
  281. <code>struct win_create.flags</code> can request
  282. <code>WIN_F_POPOVER</code>, a chromeless overlay: the canvas fills
  283. the window and the WM supplies only the topmost placement.
  284. <code>SYS_WIN_RESIZE_SELF</code> (115) resizes the caller's canvas
  285. and <code>SYS_SCREEN_INFO</code> (116) reports the framebuffer
  286. size, so a popover can collapse or grow. Input is exposed through
  287. <code>SYS_WIN_POINTER</code>
  288. (content-relative position, button mask, focus),
  289. <code>SYS_WIN_EVENT</code>, which
  290. queues press/release edges and a capture window, and
  291. <code>SYS_WIN_SCROLL</code>, which returns wheel/touchpad scroll
  292. accumulated for the window under the pointer in pixels
  293. (<code>+dy</code> is later content). A click that starts
  294. in a window still receives its release after the pointer leaves.
  295. The ngui helper <code>ngui_scroll_wheel()</code> applies the delta
  296. to a pane when the pointer is over it. A pane's scrollbar is an
  297. overlay: an 8 px rounded pill at its right edge that stays hidden
  298. while the pointer is outside, slides in over about 100 ms on
  299. hover, and never reduces the content rectangle or reflows a row.
  300. <code>hide_bar</code> suppresses it entirely.
  301. The WM process itself is special: it maps the screen shadow at
  302. <code>0x58000000</code> and each front canvas at
  303. <code>0x59000000 + index × 4 MB</code>, which is how it composites
  304. without reading another process's memory. The 4 MB slot covers a
  305. full-screen 1920×1080 RGB565 canvas (4.15 MB) minus the chrome;
  306. the old 2 MB slot capped a full-height window at roughly 1050 px
  307. wide.
  308. <code>SYS_WM_RESIZE</code> (WM side) and
  309. <code>SYS_WIN_ACK_RESIZE</code> (client side) swap in a resized
  310. canvas; the content size is bounded by the framebuffer, so a
  311. window can grow to the edge of the screen.
  312. </p>
  313. <p>
  314. Double-clicking a title bar maximizes the window to the work area
  315. below the system bar (<code>0, WM_BAR_H, fbw, fbh - WM_BAR_H</code>);
  316. the next double-click restores the saved geometry. Dropping a
  317. title-bar drag with the pointer on the left or right screen edge
  318. (<code>WM_SNAP_EDGE</code>, 2 px) snaps the window to that half of
  319. the work area at full height, and the top edge maximizes it. The
  320. restore geometry is saved only when a window leaves the normal state,
  321. so snapping and then maximizing still restores the original size.
  322. Dragging a maximized or snapped window restores it first, with the
  323. grab point kept at the same fraction of the title bar, and a manual
  324. resize clears the state. While a window is dragged, the screen edges
  325. and the facing edges of other windows resist it: the window stays
  326. flush until the pointer overshoots by <code>WM_RESIST</code> (24 px),
  327. which makes side-by-side placement exact. Windows can be dragged past the left, right and
  328. bottom edges; <code>WM_DRAG_VISIBLE</code> (48 px) of the title bar
  329. always stays on-screen for recovery, and the top bar is never
  330. overlapped. An invisible resize band (1 px inside, 3 px outside)
  331. runs along every edge and corner: the grabbed edges follow the
  332. pointer while the opposite edges stay put, clamped to the work
  333. area. While a drag or resize is active the WM owns the pointer,
  334. so the window content does not see the held button.
  335. </p>
  336. <div class="note">
  337. <p><strong>Buttons fire on the release edge.</strong> The toolkit keeps
  338. a button <code>active</code> until <code>ui-&gt;released</code>;
  339. inferring release from the sampled button mask races the WM event
  340. queue and drops clicks.</p>
  341. </div>
  342. <p>
  343. When a process exits or crashes, the reaper releases its window
  344. mappings and the window server frees the canvas. Closing a window
  345. kills its owner. Keys go through the window key queue
  346. (<code>SYS_WIN_KEY_WAIT</code>) or the generic
  347. <code>SYS_KEY_POLL</code>; Ctrl+C still reaches the terminal.
  348. </p>
  349. </section>
  350. <section id="ngui">
  351. <h2>ngui toolkit</h2>
  352. <p>
  353. <span class="file">ngui.c</span>/<span class="file">ngui.h</span> is an
  354. immediate-mode GUI toolkit shared by the ring-3 apps. It provides
  355. clipped RGB565 primitives, buttons, menu items, text fields, the
  356. Adwaita symbolic icons (see <a href="#icons">UI icons</a>), a theme palette, layout cut helpers and scrolling
  357. panes. It is linked into <code>files</code>, <code>mines</code>,
  358. <code>solitaire</code>, <code>process</code>, <code>chat</code>,
  359. the control panel and the real <code>gallery.elf</code>.
  360. </p>
  361. <ul>
  362. <li><strong>Text fields</strong> support drag-selection, double-click select-all, Ctrl+Left/Right word jumps, Ctrl+Delete/Backspace word deletion and Ctrl+A. They use the proportional face with measured caret, selection and horizontal scrolling; a field marked <code>disabled</code> ignores pointer and keyboard input, drops the focus and paints its value dimmed in the same proportional face. A field marked <code>secret</code> is measured and painted from a <code>*</code> mask (caret, selection and click positions follow the mask, Ctrl+Left/Right jump to the ends), and Tab returns <code>NGUI_INPUT_NEXT</code> together with <code>NGUI_INPUT_CANCEL</code> so forms can move the focus. Fields hold up to 511 characters (<code>NGUI_INPUT_MAX</code> 512). The terminal and editor keep the 8×16 cell grid.</li>
  363. <li><strong>Popover components</strong> give a menu panel its surface: <code>ngui_popover_begin()</code> fills the canvas and returns the body and footer rectangles (no title bar or close button); <code>ngui_section()</code> draws a captioned section header with an optional right-aligned action button; <code>ngui_list_row()</code> is a two-line hover/selected row with optional signal bars and trailing text; <code>ngui_tile()</code> is a rounded quick-settings tile and <code>ngui_slider()</code> a draggable horizontal slider. The WM draws no outer chrome, so the app paints the whole window.</li>
  364. <li><strong>Scroll panes</strong> keep the wheel and page keys, and draw a Firefox-style overlay pill instead of a permanent track. It is hidden by default, animates in from the pane's right edge while the pointer is over the pane, brightens over the hit strip and turns accent-coloured while dragged. Presses in the strip start a drag (or jump the thumb) and do not reach the rows or buttons beneath it; content uses the full pane width in every app.</li>
  365. <li><strong>Clip stack</strong> keeps nested panes and popups inside their parents.</li>
  366. <li><strong>Layout cuts</strong> split a rectangle into rows, columns and fixed margins without a constraint solver.</li>
  367. <li><strong>No retained widget tree.</strong> Apps redraw from state every frame, which keeps the toolkit small and predictable.</li>
  368. </ul>
  369. <p>
  370. Proportional text comes from <span class="file">ufont.c</span>: a
  371. fixed-point, integer-only TrueType parser and antialiased rasterizer.
  372. The pack carries Latin-1 Arimo regular/bold/italic/bold-italic,
  373. Liberation Mono and a curated monochrome Noto Emoji subset under
  374. <code>/ramfs/fonts</code>. The browser, ngui apps and the WM chrome
  375. use real pixel sizes from 8 to 48 px; the browser maps CSS
  376. <code>font-size</code>, <code>font-weight</code>,
  377. <code>font-style</code> and <code>font-family: monospace</code> to
  378. the faces. Missing fonts fall back to the 8×16 bitmap. The browser
  379. detaches the font arena before <code>heap_reset()</code> and
  380. reattaches after <code>heap_start()</code>; terminal content and
  381. the editor keep the bitmap cells.
  382. </p>
  383. <p>
  384. UTF-8 text is available through <code>ngui_text_utf8*</code> and
  385. <code>ngui_menu_item_utf8()</code>. Per codepoint, the selected
  386. primary face is tried first, then the lazily loaded emoji face;
  387. cmap format 12 covers codepoints above the BMP. The emoji set is
  388. deliberately limited to common single-codepoint glyphs that fit the
  389. rasterizer's 256-point/16-contour limits. ZWJ sequences, flags,
  390. skin tones and color glyphs fall back to a tofu or
  391. <code>?</code>; the browser keeps its Latin-1 byte path.
  392. </p>
  393. </section>
  394. <section id="apps">
  395. <h2>Applications</h2>
  396. <div class="grid">
  397. <div class="card">
  398. <h3>files</h3>
  399. <p>File browser on the VFS: opens text in <code>edit</code>, images in <code>view</code> and HTML in <code>browser</code>. The first ngui user.</p>
  400. </div>
  401. <div class="card">
  402. <h3>process</h3>
  403. <p>Graphical task manager (the top-bar <em>Tasks</em> button or <code>process</code>, the ngui counterpart of <code>top</code>): 60 s CPU, physical-memory and NIC-throughput graphs fed by one sample per second, and a sortable process table (PID, state, CPU%, memory, CPU time, name). A selected row shows its details and <em>End task</em> terminates it after a second confirming click; kernel threads and the monitor itself are protected. Headers sort, PgUp/PgDn and the wheel scroll, Esc closes.</p>
  404. </div>
  405. <div class="card">
  406. <h3>gallery</h3>
  407. <p>Live showcase of every ngui control and primitive. Ships in the pack as <code>bin/gallery.app</code>; a launcher prefers <code>/share/GALLERY</code> for development.</p>
  408. </div>
  409. <div class="card">
  410. <h3>chat</h3>
  411. <p>Cloudron Chat client: native OIDC login, channel/DM sidebar with unread badges and presence dots, a wrapped timeline with avatars, day headers, reply snippets and link-preview cards (site, title, description and an optional thumbnail; clicking one opens the link in the browser), a composer and browse/new-DM pickers. Media downloads use a warm <code>curl __serve</code> helper; message images are also decoded there (480&times;320 bounds), while avatars decode at 32&times;32 on the chat thread, so the window keeps drawing. Saved sessions resume from <code>/data</code>. The top-bar <em>Chat</em> button launches it.</p>
  412. </div>
  413. <div class="card">
  414. <h3>disks</h3>
  415. <p>Storage manager: devices, MBR partitions and mounts, per-volume mount name, read-only and automount, and Format / Install NebOS dialogs that show the kernel command's output. The top-bar <em>Disks</em> button and the <em>Disks</em> button in <code>files</code> launch it.</p>
  416. </div>
  417. <div class="card">
  418. <h3>solitaire</h3>
  419. <p>Klondike with drag-and-drop, draw-one/three, scoring, animation and pixel-art cards on the canvas service.</p>
  420. </div>
  421. <div class="card">
  422. <h3>view</h3>
  423. <p>Image viewer with fit, 1:1, zoom, pan, EXIF orientation and animated GIF playback.</p>
  424. </div>
  425. <div class="card">
  426. <h3>clock / colors / settime</h3>
  427. <p>Small canvas demos: an analog clock, a colour test window, and the standalone Date &amp; Time editor (<code>settime</code>). The control panel's Date &amp; Time tile reveals its own inline editor, which reads and writes the CMOS RTC and can fetch UTC from an SNTP server.</p>
  428. </div>
  429. <div class="card">
  430. <h3>browser</h3>
  431. <p>HTML/CSS renderer with flex rows, auto-fit and <code>repeat(N, 1fr)</code> card grids, <code>aspect-ratio</code> frames, inline-block runs, inline SVG icons, basic tables and inline SVG diagrams. It decodes inline images at their laid-out bounds (a JPEG gets a reduced IDCT) in the fetch helper, caches a display-size bitmap per image so repaints are 1:1, and fetches through the same helper; image repaints are coalesced and <code>/share/IMGSTAT</code> reports where a load spent its time. Inline and external scripts run on the vendored QuickJS engine (ES2025), and forms render and submit natively. The largest ring-3 application in the tree.</p>
  432. </div>
  433. </div>
  434. </section>
  435. <section id="images">
  436. <h2>Image library</h2>
  437. <p>
  438. The codecs are independent of the OS and the toolkit: each takes an
  439. input buffer plus a caller-provided <code>struct img_mem</code> arena
  440. and returns an RGB565 image with an optional 8-bit alpha plane. The
  441. browser and the chat client link the same objects and decode HTTP
  442. bodies in memory.
  443. </p>
  444. <ul>
  445. <li><strong>Formats.</strong> PNG, baseline and progressive JPEG, animated GIF, BMP, TGA, PNM, ICO/CUR and PAM. The browser also takes SVG files (<code>&lt;img src="logo.svg"&gt;</code>, CSS backgrounds): the markup is parsed into a detached subtree and drawn by its inline-SVG renderer into an RGB565 + alpha bitmap.</li>
  446. <li><strong>Drawing.</strong> <code>img_draw()</code> is a clipped, scaled RGB565 blit: box-filter downscale, bilinear upscale, alpha over a checkerboard or over the destination. A 1:1 opaque source takes a row copy, and a 1:1 alpha source blends in RGB565 without the 8-bit round trip.</li>
  447. <li><strong>Display-size decode.</strong> <code>struct img_options</code> carries optional <code>max_w</code>/<code>max_h</code> bounds. JPEG honours them with a scaled IDCT (1/2 4x4, 1/4 2x2, 1/8 1x1, Loeffler/IGJ), so a 1200x800 photo painted at 400&times;267 is decoded at roughly 600&times;400 instead of full size and then box-filtered. PNG/GIF/other codecs ignore the bounds and the caller scales them with <code>img_draw()</code>. The browser's <code>curl __serve</code> helper runs this decode for remote <code>&lt;img&gt;</code> and publishes the finished RGB565+alpha bitmap, so the UI thread only copies it.</li>
  448. <li><strong>Orientation.</strong> EXIF orientation is applied; arithmetic JPEG and CMYK are rejected.</li>
  449. <li><strong>Cost.</strong> Downscaling runs on the CPU. The browser decodes at the CSS/attribute box and caches one display-size bitmap per image, so a repaint is a 1:1 blit; the viewer caches one image; the chat client caches 480&times;320 message images and 32&times;32 circular avatars. <code>/share/IMGSTAT</code> records the browser's net, io, decode, scale, paint and reflow times.</li>
  450. </ul>
  451. </section>
  452. <section id="icons">
  453. <h2>UI icons</h2>
  454. <p>
  455. ngui's icons (<code>ngui_icon()</code>, <code>ngui_icon_button()</code>:
  456. back/forward, reload and home in the browser toolbar, folder/file/drive
  457. in <code>files</code>) and the WM's top-bar network/battery
  458. indicators are GNOME Adwaita symbolic icons
  459. (adwaita-icon-theme 51, LGPL-3 or CC-BY-SA-3.0). The unchanged
  460. <code>*-symbolic.svg</code> files live in
  461. <span class="file">assets/icons/adwaita/</span>; the host tool
  462. <span class="file">tools/mkicons.c</span> rasterizes each one with the
  463. browser's <span class="file">svg_raster.c</span> into a 16&times;16
  464. 8-bit coverage mask and writes one <code>NBICO1</code> bundle,
  465. <code>/ramfs/icons/adwaita16.icn</code> (layout in
  466. <span class="file">include/icon_abi.h</span>): a 16-byte header and
  467. 24 masks, ~6.2&nbsp;KB raw and ~1.3&nbsp;KB gzip, so both the USB
  468. and the floppy pack carry it.
  469. </p>
  470. <ul>
  471. <li><strong>Icon list.</strong> <code>ICON_LIST</code> is an X-macro of enum suffix, short name and theme file. Its order is the icon id and the bundle order (append only); it generates <code>enum ngui_icon</code> and <code>ngui_icon_name()</code>, and the gallery shows every entry. <code>uwm_lib.h</code> applies the same list to <code>enum uwm_icon</code>, so the ring-3 WM can use ids without linking ngui.</li>
  472. <li><strong>Tinting.</strong> Symbolic icons are one colour, so only coverage is stored. <code>ngui_icon()</code> blends the mask in the caller's colour (the theme text colour on buttons, <code>icon_folder</code>/<code>icon_disk</code>/<code>icon_file</code> in <code>files</code>), centred and clipped. <code>usurf_icon()</code> does the same over the WM's 16/24/32 bpp shadow. The bar's battery clears the striped <code>battery</code> mask's interior to a quarter-brightness shade and draws its level fill over the lower part, so the gauge reads at 16&nbsp;px.</li>
  473. <li><strong>Loading.</strong> Each process (every ngui app and the WM) reads the bundle once into a BSS buffer, so the browser's <code>heap_reset()</code> cannot free it. The read is capped at the ids the process was built with, so an older app still works with a newer bundle. Without the bundle the icon is left blank; there is no line-drawn fallback, because it cost ~2&nbsp;KB of code in each app.</li>
  474. <li><strong>Strict converter.</strong> mkicons reads only what symbolic icons use (<code>&lt;svg viewBox&gt;</code>, <code>&lt;g&gt;</code>, <code>&lt;path&gt;</code>, <code>&lt;rect&gt;</code>, <code>&lt;circle&gt;</code>, <code>&lt;ellipse&gt;</code>, fill, fill-rule, opacity) and fails the build on transforms, strokes, <code>style</code> or unknown elements instead of drawing a wrong icon. <code>./mkicons assets/icons/adwaita 16 out.icn -v</code> prints an ASCII preview of every mask.</li>
  475. </ul>
  476. </section>
  477. <section id="cursors">
  478. <h2>Mouse cursors</h2>
  479. <p>
  480. The cursor set is the GNOME Adwaita theme (adwaita-cursors 51,
  481. LGPL-3 or CC-BY-SA-3.0). Its 24&nbsp;px Xcursor images are copied
  482. into <span class="file">assets/cursors/adwaita/</span> (trimmed by
  483. <span class="file">tools/xcursor_trim.py</span>), and the host tool
  484. <span class="file">tools/mkcursors.c</span> turns them into one
  485. <code>NBCUR1</code> bundle, <code>/ramfs/cursors/adwaita24.cur</code>
  486. (layout in <span class="file">include/cursor_abi.h</span>):
  487. 35 shapes named after the CSS <code>cursor</code> keywords, each
  488. with its size, hotspot, frame count and premultiplied ARGB8888
  489. frames. The animated <code>wait</code>/<code>progress</code>
  490. spinners keep every fourth of Adwaita's 60 frames (15 frames at
  491. 64&nbsp;ms, the same speed). The bundle is ~146&nbsp;KB raw,
  492. ~18&nbsp;KB gzip, and only in the full pack: the floppy lite pack
  493. has no room, so a floppy boot keeps the built-in 16&times;16 arrow.
  494. </p>
  495. <ul>
  496. <li><strong>Loading.</strong> <span class="file">cursor.c</span> copies the bundle out of the ramfs into its own pages after <code>ramfs_init()</code> and after every <code>ramfs_replace()</code> (the old pack is freed), then tells <span class="file">mouse.c</span> to re-fetch its image.</li>
  497. <li><strong>Selection.</strong> On every <code>SYS_WM_POLL</code> the window server resolves the shape: the WM's override (<code>SYS_WM_SET_CURSOR</code>: resize arrows on the resize band and while resizing, the move cross during a title-bar drag, a hand over launchers and the status area), else the cursor of the window holding the pointer capture, else the content cursor (<code>SYS_WIN_SET_CURSOR</code>) of the window under the pointer, else the arrow.</li>
  498. <li><strong>Clients.</strong> ngui resets the cursor to the arrow for each redrawn frame, a hovered text field asks for the I-beam, <code>ngui_cursor_rect()</code>/<code>ngui_set_cursor()</code> serve apps, and <code>ngui_end_ex()</code> sends it when it changed. The terminal uses the I-beam; the browser maps the inherited CSS <code>cursor</code> property and, for <code>auto</code>, a hand over links, an I-beam over text fields and the progress arrow while a page loads. The gallery's Cursors section shows every shape.</li>
  499. <li><strong>Drawing.</strong> <code>cur_x</code>/<code>cur_y</code> stay the hotspot; the image's top-left is the hotspot minus the image's hotspot and may be off-screen. The software cursor saves up to 32&times;32 pixels under it and blends the premultiplied pixels over them. Intel Ironlake and Radeon copy the ARGB image into their 64&times;64 planes (Intel uses CURPOS sign bits for negative positions and follows the matching primary plane's gamma enable, because the display palette is after the plane blender and a cursor-only gamma pass brightens its antialiased edges on a VBE mode whose primary bypasses the palette; Radeon uses <code>HORZ_VERT_OFF</code> plus a shifted <code>CUR_OFFSET</code>); Cirrus reduces it to its two colours and clamps the position at 0. Animated frames advance from <code>mouse_poll_update()</code>.</li>
  500. </ul>
  501. </section>
  502. <section id="gpu">
  503. <h2>GPU quirks</h2>
  504. <ul>
  505. <li><strong>ATI Mach64.</strong> A CRTC fixup is applied after mode set. The legacy CRTC is skipped under UEFI.</li>
  506. <li><strong>NVIDIA.</strong> VBE/GOP only; the kernel never touches the legacy VGA CRTC. On the ION, the framebuffer is stolen DRAM behind a BAR3 aperture; <span class="file">nvidia.c</span> finds the stolen range and writes through a cached alias once a WC MTRR covers it. The nv50 display-engine probe is gated to the ION/nv50 chipsets so Maxwell parts (the GM206 GTX 960) are not poked through nv50 registers. On AMD family 15h the WC MTRR path uses only a free variable entry, leaves <code>MTRRdefType</code> untouched and writes a zero high mask (the LFB is below 4 GB); this is validated on the 970A-DS3P.</li>
  507. <li><strong>Intel.</strong> The Ironlake-era path supports a hardware cursor where available; the software cursor is the common fallback. Cherryview/Braswell also exposes the panel backlight (below).</li>
  508. <li><strong>UEFI.</strong> <code>vga.c</code> honours the RGBX flag and skips the VBE-only ATI CRTC reset and NVIDIA stolen-VRAM alias. <span class="file">mouse.c</span> forces the software cursor.</li>
  509. </ul>
  510. </section>
  511. <section id="backlight">
  512. <h2>Panel backlight</h2>
  513. <p>
  514. The HP Chromebook 11 G5 (<code>google/setzer</code>, Braswell)
  515. drives its internal panel PWM from the display engine, not from
  516. the Chrome EC. The board VBT (<code>data.vbt</code>, block 43)
  517. declares PWM controller 0 at 200 Hz, active high. Linux uses the
  518. same Valleyview/Cherryview registers through
  519. <code>intel_backlight</code>.
  520. </p>
  521. <ul>
  522. <li><strong>Registers.</strong> <code>BLC_PWM_CTL2</code> at GPU BAR0 + <code>0x1E1250</code> (pipe A; pipe B is <code>+0x100</code>): bit 31 enables, bit 28 is polarity. <code>BLC_PWM_CTL</code> at <code>0x1E1254</code>: period in bits 31:16, duty in bits 15:0. The Cherryview PWM clock is 19.2 MHz with a fixed /16 increment, so 200 Hz is a period of 6000.</li>
  523. <li><strong>Probe.</strong> <span class="file">backlight.c</span> matches Intel <code>8086:22b0</code>/<code>22b1</code>, maps the graphics MMIO BAR, reads both pipes, follows the one the firmware enabled and falls back to controller 0. It logs the chosen pipe, period, duty and raw registers to COM1.</li>
  524. <li><strong>Use.</strong> The <code>backlight</code> command prints the percentage and PWM state; <code>backlight up|down</code> steps by 10%, <code>backlight 0-100</code> sets a level (clamped to 5..100), and <code>backlight probe</code> dumps both pipes' registers. <code>SYS_BACKLIGHT</code> gives ring 3 the same get/set/step, which drives the control panel's brightness slider. F6/F7 (the ChromeOS EC action-row brightness keys) and the standard <code>E0 14</code>/<code>E0 15</code> brightness scancodes adjust it; the keys are consumed in <span class="file">io.c</span> and never reach a window.</li>
  525. <li><strong>Overlay.</strong> <code>SYS_WM_POLL</code> also reports the backlight percentage and a change counter. After each change the ring-3 WM (<span class="file">ucmd_wm.c</span>) draws a centered <em>Brightness</em> bubble with a sun icon, the percentage and a level bar, keeps it up for 3 s, and composits it above the windows on every pass while it is visible.</li>
  526. <li><strong>Limits.</strong> Only the Cherryview/Braswell native PWM (<code>8086:22b0</code>/<code>22b1</code>) is driven. The level is not persisted; a cold boot returns to the firmware's duty.</li>
  527. </ul>
  528. </section>
  529. <section id="sources">
  530. <h2>Source map</h2>
  531. <ul class="filelist">
  532. <li><code>kernel/vga.c</code>, <code>kernel/vga.h</code> — framebuffer and damage</li>
  533. <li><code>kernel/bootcon.c</code> — direct-to-LFB boot console</li>
  534. <li><code>kernel/vga_copy.S</code> — copy primitives</li>
  535. <li><code>kernel/blit.c</code>, <code>kernel/blit.h</code> — pixel vtable</li>
  536. <li><code>kernel/cpu.c</code> — SSE2 probing</li>
  537. <li><code>kernel/wm.c</code>, <code>kernel/wm.h</code>, <code>include/wm_abi.h</code> — kernel window server and shared ABI</li>
  538. <li><code>user/apps/wm/ucmd_wm.c</code>, <code>user/lib/uwm/uwm_lib.c</code> — ring-3 WM</li>
  539. <li><code>user/apps/netmenu/ucmd_netmenu.c</code> — top-bar control panel (network/WiFi, brightness, power mode, Date &amp; Time)</li>
  540. <li><code>user/apps/settime/ucmd_settime.c</code>, <code>kernel/rtc.c</code>, <code>kernel/ntp.c</code> — Date &amp; Time editor, RTC access and SNTP sync</li>
  541. <li><code>kernel/gfx.c</code>, <code>kernel/gfx.h</code> — RGB565 window canvases</li>
  542. <li><code>kernel/sys_wm.c</code>, <code>kernel/sys_wm.h</code> — WM/window ABI</li>
  543. <li><code>user/apps/browser/browser.c</code>, <code>user/apps/browser/browser_html.c</code> — HTML/CSS renderer and inline SVG</li>
  544. <li><code>user/lib/ngui/ngui.c</code>, <code>user/lib/ngui/ngui.h</code> — toolkit</li>
  545. <li><code>user/lib/ufont/ufont.c</code>, <code>user/lib/ufont/ufont_ttf.c</code>, <code>user/lib/ufont/ufont_draw.c</code> — fixed-point TrueType text</li>
  546. <li><code>fonts/*.ttf</code> — Arimo / Liberation Mono / Noto Emoji subsets in the pack</li>
  547. <li><code>user/apps/files/ucmd_files.c</code>, <code>user/apps/process/ucmd_process.c</code>, <code>user/apps/gallery/gallery.c</code>, <code>user/apps/solitaire/ucmd_solitaire.c</code>, <code>user/apps/chat/ucmd_chat.c</code></li>
  548. <li><code>user/lib/img/img*.c</code> — image codecs</li>
  549. <li><code>kernel/ati.c</code>, <code>kernel/nvidia.c</code>, <code>kernel/intel.c</code>, <code>kernel/nv50.c</code></li>
  550. <li><code>kernel/backlight.c</code>, <code>kernel/backlight.h</code> — Cherryview/VLV panel PWM</li>
  551. <li><code>kernel/cursor.c</code>, <code>kernel/cursor.h</code>, <code>kernel/mouse.c</code>, <code>kernel/cursor_shape.h</code> — cursor bundle loader, drawing and the built-in fallback arrow; <code>kernel/cirrus.c</code>, <code>kernel/radeon.c</code> — hardware cursors</li>
  552. <li><code>include/icon_abi.h</code>, <code>tools/mkicons.c</code>, <code>assets/icons/adwaita/</code> — UI icon list, the NBICO1 bundle and the Adwaita symbolic SVGs</li>
  553. <li><code>include/cursor_abi.h</code>, <code>tools/mkcursors.c</code>, <code>tools/xcursor_trim.py</code>, <code>tools/cursor_test.c</code>, <code>assets/cursors/adwaita/</code> — cursor shapes, the NBCUR1 bundle and the Adwaita source images</li>
  554. </ul>
  555. </section>
  556. </main>
  557. <footer class="site-footer">
  558. <div class="inner">
  559. <p><strong>NebOS 0.2.0</strong> · Architecture documentation · <a href="index.html">overview</a></p>
  560. <p>Maintain alongside <code>AGENTS.md</code> and the source files listed on each page.</p>
  561. </div>
  562. </footer>
  563. </body>
  564. </html>