Every feature the site supports, on one page, to check after changing templates, styles or build scripts. This page is kept out of the writings list, tag pages, RSS and the sitemap, and asks search engines not to index it. The first paragraph opens with a drop cap, and each paragraph after it is indented.

Like this one. It also has bold, italic, underline, strikethrough, verbatim, code, and a long unbroken URL as link text: https://en.wikipedia.org/wiki/Mechanistic_interpretability.

Internal links open in the same tab: writings, books, a tag page, and a section on this page. External links open in a new tab, and some get a logo:

A logo stays on the line with the end of its link, even at the end of a line in a narrow window: Hangul. Links inside code get no logo: https://github.com.

Sidenotes

A sidenote sits in the margin on wide screens and opens on tap on narrow ones.1 A numbered note. It's long enough to wrap onto several lines in the margin, to check line height and spacing against the text beside it. Inline notes work too.2 An inline note, written right where it's referenced. A note can hold math and links.3 With math, ∫01f=0\int_0^1 f = 0, and a link. A note referenced twice keeps its number the second time, without a second note.1

A note can have several paragraphs.4 The first paragraph of the note. The second paragraph of the note.

Math

Inline math such as WQK=WQWKTW_{QK} = W_Q W_K^T and α+β=β+α\alpha + \beta = \beta + \alpha sits in the text. Display math gets its own line:

A=softmax(xiWQKxjTdhead) A = \text{softmax}\left(\frac{x_i W_{QK} x_j^T}{\sqrt{d_{\text{head}}}}\right)

Aligned equations, with a matrix:

q=xiWQk=xjWK[head1head2⋯headn]WO=∑hheadhWOh \begin{aligned} q &= x_i W_Q \\ k &= x_j W_K \\ \begin{bmatrix} \text{head}_1 & \text{head}_2 & \cdots & \text{head}_{n} \end{bmatrix} W_O &= \sum_{h} \text{head}_h W_O^h \end{aligned}

Headings

Each heading links to itself, with a § in the left margin and a button that copies its link. Headings appear in the contents.

A second-level heading

A third-level heading

Text under the deepest heading.

A heading that already holds a link links to itself through the § alone.

Repeated title

The second repeated heading gets a numbered id.

Korean

Hangul uses Source Han Serif KR: 안녕하세요, 저는 알리셰르입니다. In bold: 한국어를 공부하고 있어요.

Blocks

Lists

  • An unordered item

  • Another, with nested items:

    • Nested
    • Nested again
  1. An ordered item

  2. Another

    1. Nested
Term
Its definition
Another term
Another definition

Quote

Show that α+β=β+α\alpha + \beta = \beta + \alpha for all α,β∈C\alpha, \beta \in \mathbf{C}.

Sheldon Axler, Linear Algebra Done Right, 4th ed., Exercise 1A.1

Code

def attention(q, k, v):
    scores = q @ k.T / q.shape[-1] ** 0.5
    return softmax(scores) @ v  # see https://github.com, no logo here

Table

model shot moved unfaithfulness
Opus 0 1 1.000
Llama 3 84 0.952

Details

Folded content

Text that shows when the details open.

Images

/images/posts/seeing-superposition/superposition.svg
An image with a caption

An image without a caption, as raw HTML:

Hint schematic

Attention visualization

With a field selector:

With a single field:

Values shared with the prose

Words can point a figure at something: compare L10H2, normalized with L10H6, raw. Pointing at either outlines the figure it changes.

The figure is showing L0H0, where "France" attends to "Paris" with a score of ….

A number to drag: 3 is 3. A choice that cycles: apple, now apple. A toggle: on.

Connect 4

A board that publishes its game: after … moves it reads …. Try a quick win.