{ "componentChunkName": "component---src-templates-blog-post-js", "path": "/the-preview-failed-the-command-did-not/", "result": {"data":{"markdownRemark":{"id":"cb7e2681-4a42-5f02-b818-88f8bf434cce","excerpt":"At 2:14 on a Sunday morning, the mobile app told me it could not load a link preview. My server disagreed. The URL I had pasted into the app did not contain…","html":"

At 2:14 on a Sunday morning, the mobile app told me it could not load a link preview.

\n

My server disagreed.

\n
02:14:07  GET /proof/4f6c2/uid-1001 HTTP/1.1\n           Host: canary.example.test\n           User-Agent: curl/7.81.0\n           Source: 203.0.113.74
\n

The URL I had pasted into the app did not contain canary.example.test.

\n

The web page at the end of the redirect did not contain it either.

\n

Only one thing contained that hostname: a short, deliberately harmless command embedded inside a parameter sent to a service that was supposed to exist only on 127.0.0.1.

\n

The app showed a gray chain icon and Preview unavailable.

\n

The command had already run.

\n

I stared at the access log long enough for the line to stop looking like text and start looking like impact.

\n

Then I closed the terminal, opened a new note, and wrote:

\n
02:15 — probable command execution on preview worker\n02:16 — do not inspect filesystem\n02:16 — do not read environment\n02:17 — reproduce once with new token, then report
\n

The bug began as a URL preview in a mobile chat composer.

\n

It ended as remote command execution in production.

\n

Between those two things were one redirect, one assumption about localhost, and one pair of quotation marks.

\n

The feature I was not testing

\n

$COMPANY was a mobile-first collaboration app. Teams used it for chat, files, voice notes, and the usual collection of tiny conveniences that eventually become infrastructure.

\n

When someone pasted a URL into a message, the app generated a card:

\n
┌──────────────────────────────────────────────┐\n│ The boring engineering behind tiny models   │\n│ Models are large. Habits are surprisingly   │\n│ portable.                                    │\n│                                    example   │\n└──────────────────────────────────────────────┘
\n

The title, description, site name, and image came from $COMPANY’s servers, not from the phone. That is sensible. A backend can fetch a page once, cache the result, resize images consistently, and avoid making every recipient’s device contact an arbitrary third-party host.

\n

It also means the backend is willing to visit a URL chosen by a user.

\n

That sentence is where SSRF lives.

\n

I had opened the Android application because its link cards looked slightly different from the web version. The web client discarded malformed pages quietly. Android sometimes returned an error description under the gray placeholder.

\n

Different error handling often means different code.

\n

I searched the APK for preview and found a small Retrofit interface:

\n
interface PreviewApi {\n    @POST(\"mobile/v3/link-previews\")\n    suspend fun createPreview(\n        @Body request: PreviewRequest\n    ): PreviewCard\n}\n\ndata class PreviewRequest(\n    val url: String,\n    val locale: String,\n    val appVersion: String\n)
\n

The endpoint required an ordinary account. No administrator role, enterprise plan, or special workspace permission was involved. The mobile client called it as soon as a URL appeared in the composer, before the message was sent.

\n

With my own test account, the request looked like this:

\n
POST /api/mobile/v3/link-previews HTTP/1.1\nHost: api.$COMPANY.example\nAuthorization: Bearer <test-account-token>\nContent-Type: application/json\nX-Client: android/7.42.1\n\n{\n  \"url\": \"https://research.example.test/ordinary-page\",\n  \"locale\": \"en-US\",\n  \"appVersion\": \"7.42.1\"\n}
\n

The response was unsurprising:

\n
{\n  \"title\": \"ordinary page\",\n  \"description\": \"a page controlled for testing\",\n  \"site_name\": \"research.example.test\",\n  \"image_url\": null\n}
\n

My server received two requests from an address belonging to $COMPANY: first HEAD, then GET.

\n

That established the basic fact. The phone was not fetching the page. $COMPANY was.

\n

The next question was where it was willing to go.

\n

The filter looked better than most

\n

I tried the obvious internal destinations directly.

\n
http://127.0.0.1/\nhttp://localhost/\nhttp://10.0.0.1/\nhttp://169.254.169.254/
\n

All four failed before a network request was made:

\n
{\n  \"error\": \"url_not_allowed\",\n  \"message\": \"Private or reserved destinations cannot be previewed\"\n}
\n

That was good. Better than good, actually. Plenty of preview endpoints still fail at the first sentence of SSRF prevention.

\n

The service also rejected non-HTTP schemes, URLs containing credentials, bare hostnames without a dot, and several unusual textual forms of loopback addresses. Somebody had clearly thought about this.

\n

For a minute I considered moving on.

\n

Then I tested a public URL that redirected to another public URL. The preview followed it.

\n

That is normal behavior for the web. It is also a second URL-validation problem hiding inside the first one.

\n

The application had answered:

\n
\n

Is the URL the user submitted safe?

\n
\n

It had not yet answered:

\n
\n

Is every URL the server will actually request safe?

\n
\n

I configured my public test endpoint to return one redirect:

\n
HTTP/1.1 302 Found\nLocation: http://127.0.0.1:3001/\nCache-Control: no-store
\n

Then I submitted the public address—not the loopback address—to the mobile preview API.

\n
{\n  \"url\": \"https://research.example.test/to-loopback\",\n  \"locale\": \"en-US\",\n  \"appVersion\": \"7.42.1\"\n}
\n

The request passed the filter.

\n

My server returned the redirect.

\n

The preview response came back three seconds later:

\n
{\n  \"title\": \"mobile-renderer\",\n  \"description\": \"internal screenshot service\",\n  \"site_name\": \"127.0.0.1\",\n  \"image_url\": null\n}
\n

I had not bypassed the IP parser.

\n

I had walked around it.

\n

The original host was public. The destination after the redirect was not. The filter examined the first and the HTTP client trusted the rest.

\n

In Python-shaped pseudocode, the bug was probably close to this:

\n
def preview(user_url: str) -> Preview:\n    parsed = parse_url(user_url)\n    resolved = resolve(parsed.hostname)\n\n    if not is_public_address(resolved):\n        raise UrlNotAllowed()\n\n    # requests follows redirects for GET by default\n    response = requests.get(\n        user_url,\n        timeout=5,\n        headers={\"User-Agent\": PREVIEW_USER_AGENT},\n    )\n\n    return extract_preview(response)
\n

The validation and the request each looked reasonable in isolation.

\n

The problem was that response might belong to a different host from user_url.

\n

A redirect is not a continuation of the same trust decision. It is a new request.

\n

I did not scan the network

\n

Once an application will fetch loopback URLs, it is tempting to turn the preview endpoint into an internal port scanner.

\n

That is also an efficient way to stop doing research and start creating unnecessary risk.

\n

I tested only a handful of common local development ports, one request at a time, with long pauses. I stopped at the first identifiable service. The report included the exact list and timestamps so $COMPANY could distinguish my traffic from anything else.

\n

Port 3001 returned an HTML page with this title:

\n
<title>mobile-renderer</title>
\n

The body was a tiny internal status screen:

\n
mobile-renderer\nbuild: 2023.08.11-4d8c2f1\nmode: production\n\nGET /health\nGET /debug/render?url=<url>&width=<pixels>
\n

The interesting word was not render.

\n

It was debug.

\n

The endpoint was bound to loopback, so it had no authentication. From the perspective of its author, that may have felt like authentication: only software on the same machine could reach it.

\n

The preview service was software on the same machine.

\n

And I could tell the preview service where to go.

\n
mobile user\n    │\n    │  public URL\n    ▼\nlink-preview API\n    │\n    │  follows 302\n    ▼\n127.0.0.1:3001\n    │\n    ▼\nmobile-renderer debug route
\n

A network boundary had become a permission boundary without anybody writing down that decision.

\n

The first render was harmless

\n

I sent the renderer a normal public page through the redirect chain:

\n
https://research.example.test/to-render\n  └── 302 → http://127.0.0.1:3001/debug/render\n              ?url=https%3A%2F%2Fexample.org%2F\n              &width=800
\n

The mobile API waited several seconds and returned a screenshot URL hosted on $COMPANY’s CDN.

\n

That proved three things:

\n
    \n
  1. The preview worker could reach the renderer.
    2. \n
  2. The renderer accepted unauthenticated requests from loopback.
    3. \n
  3. The renderer performed a meaningful action, not merely a health check.
    4. \n
\n

The generated image showed example.org. I deleted the preview from my test workspace and did not request any internal page.

\n

At this point the finding was already serious SSRF. An ordinary mobile user could invoke internal HTTP endpoints and retrieve at least some of their output through the preview parser or generated artifacts.

\n

But the renderer’s error behavior suggested there was another boundary behind it.

\n

I changed the url parameter from a valid address to one containing a single encoded quotation mark.

\n

The render failed immediately.

\n

The mobile response included the first line of stderr:

\n
{\n  \"error\": \"preview_generation_failed\",\n  \"detail\": \"/bin/sh: 1: Syntax error: Unterminated quoted string\"\n}
\n

A URL parser does not normally complain about shell quotes.

\n

A shell does.

\n

I wrote a second note:

\n
01:46 — renderer likely builds command string\n01:48 — do not guess broadly\n01:49 — one canary-only proof
\n

The pair of quotation marks

\n

From the outside, the renderer appeared to launch a headless browser script with a command assembled as text.

\n

The vulnerable code may have looked like this:

\n
import { exec } from \"node:child_process\";\nimport { randomUUID } from \"node:crypto\";\n\napp.get(\"/debug/render\", (req, res) => {\n  const target = req.query.url;\n  const width = req.query.width || \"800\";\n  const output = `/tmp/${randomUUID()}.png`;\n\n  const command =\n    `timeout 20s node capture.js ` +\n    `--url \"${target}\" ` +\n    `--width ${width} ` +\n    `--output \"${output}\"`;\n\n  exec(command, (error) => {\n    if (error) {\n      return res.status(500).send(error.message);\n    }\n\n    res.sendFile(output);\n  });\n});
\n

exec() does not pass an argument array directly to a program. It starts a shell and gives the shell one command string.

\n

That distinction is convenient when the command is constant.

\n

It is dangerous when part of the string came from an HTTP request.

\n

The renderer placed target inside double quotes, but quotes are not a security boundary. They are syntax. If untrusted input can alter that syntax, the shell gets to interpret the remainder.

\n

I am not including the command-separator bytes used in the report. They add nothing to the engineering lesson and make the article more reusable than it needs to be.

\n

The proof itself was deliberately small:

\n\n

The public redirect server never mentioned the canary hostname. The target page never mentioned it. Only the injected fragment did.

\n

At 2:14:07, the canary request arrived:

\n
GET /proof/4f6c2/uid-1001 HTTP/1.1\nHost: canary.example.test\nUser-Agent: curl/7.81.0
\n

The source address matched the preview infrastructure.

\n

The user agent did not match the preview fetcher or headless Chromium.

\n

The path included the expected one-time token and uid-1001.

\n

I repeated the test with a different token and received a second request.

\n

Then I used a benign delay as an independent signal. A normal failed render returned in about 600 milliseconds. The redacted test delayed the response by five seconds, three times in a row.

\n

Two different observations now pointed to the same conclusion:

\n
user-controlled mobile request\n  → server-side redirect to loopback\n  → unauthenticated internal render endpoint\n  → shell command injection\n  → command execution as uid 1001
\n

The preview failed.

\n

The command did not.

\n

Why this was RCE even without a reverse shell

\n

“Remote code execution” sometimes gets confused with a cinematic terminal window.

\n

The terminal is optional.

\n

The security boundary fails when an untrusted remote user can cause the target to execute an operating-system command of the user’s choosing. A one-shot canary request is enough to prove that boundary failed.

\n

I did not establish persistence. I did not enumerate the container. I did not inspect mounted volumes, credentials, service-account tokens, customer data, or neighboring services. I did not test whether the process could escape its container.

\n

Those actions would have increased risk without changing the finding.

\n

The report said exactly what I had confirmed:

\n
Confirmed:\n- Any ordinary account can invoke the mobile link-preview endpoint.\n- URL validation applies to the initial URL only.\n- Redirects can reach loopback services.\n- A loopback-only renderer interpolates the `url` parameter into a shell command.\n- Arbitrary command execution is possible as the renderer user (uid 1001).\n- The worker has outbound network access.\n\nNot tested:\n- Filesystem contents\n- Environment variables or credentials\n- Access to customer data\n- Access to cloud metadata\n- Container escape\n- Lateral movement\n- Persistence
\n

That separation matters. A report should make the proven impact difficult to dismiss and the untested impact impossible to mistake for a claim.

\n

$COMPANY later confirmed that the renderer ran in a production container with read access to a preview-object bucket and credentials for an internal logging service. It did not hold mobile signing keys.

\n

I had not accessed any of them.

\n

The RCE was severe without borrowing impact from secrets I did not need to touch.

\n

The mobile part was only the handle

\n

No command ran on my phone.

\n

The APK contained the endpoint and supplied the user-controlled URL, but the vulnerable code lived in the backend services supporting the mobile experience.

\n

That distinction is worth making because “mobile vulnerability” often gets interpreted as memory corruption, a malicious intent, or code execution on a handset.

\n

This was different:

\n
Android app\n   │  authenticated API request\n   ▼\nmobile preview backend\n   │  SSRF\n   ▼\nloopback renderer\n   │  command injection\n   ▼\nproduction container
\n

The phone was the handle.

\n

The backend was the blade.

\n

The web application did not reproduce the issue because it called a newer GraphQL preview service. That service rejected redirects entirely. Android and iOS still used the older /mobile/v3/link-previews route for latency and compatibility reasons.

\n

One product had two implementations of the same convenience feature.

\n

Only one of them had received the security fix.

\n

This is how old APIs become vulnerability museums: they continue to work, which is mistaken for evidence that they continue to be safe.

\n

The report

\n

I sent the report at 02:43 UTC, twenty-nine minutes after the first command-execution proof.

\n

The title was intentionally boring:

\n
Critical: mobile link-preview SSRF to loopback renderer leads to OS command execution
\n

The first page contained only the chain and impact:

\n
Precondition:\n  Any authenticated user account.\n\nEntry point:\n  POST /api/mobile/v3/link-previews\n\nRoot causes:\n  1. Initial URL is validated, but redirect destinations are not.\n  2. Loopback renderer trusts network location instead of authenticating callers.\n  3. Renderer passes a user-controlled URL to child_process.exec().\n\nImpact:\n  Remote command execution on a production preview worker as uid 1001.\n\nSafety:\n  Tested only with owned accounts, controlled hosts, one canary callback,\n  and a benign timing proof. No data or credentials accessed.
\n

Then came the exact reproduction, request IDs, timestamps, the two random canary tokens, source IPs, and a screen recording showing the mobile app’s failed preview beside the canary log.

\n

I included three fixes rather than one because the exploit had three independent trust failures:

\n
    \n
  1. Revalidate every redirect hop and block non-public destinations at the network layer.
    2. \n
  2. Remove or authenticate the loopback debug route.
    3. \n
  3. Stop invoking a shell with user-controlled text.
    4. \n
\n

At 03:11, the program acknowledged the report.

\n

At 03:37, an engineer asked one question:

\n
\n

Does command execution require the renderer to return a successful image?

\n
\n

It did not.

\n

The command ran before the render callback returned, so the outer API could show an error while the side effect had already happened.

\n

That explained the title I had not yet written.

\n

At 04:02, $COMPANY disabled preview generation on the mobile endpoint. Pasted links still sent as text, but no card was created.

\n

At 12:26, the report was marked critical.

\n

Three patches, not one

\n

The permanent fix arrived five days later.

\n

1. Every destination became a new decision

\n

The preview fetcher no longer followed redirects automatically. It processed them one at a time, resolving and validating each destination before making the next request.

\n

The invariant was written like this in the remediation notes:

\n
For the initial URL and every redirect hop:\n\nscheme ∈ {http, https}\nresolved address is globally routable\nconnected address equals a validated resolution\ndestination is not loopback, private, link-local, multicast, or reserved\nredirect count ≤ 3\nresponse size and time are bounded
\n

Application validation was backed by an egress rule preventing the preview network from reaching loopback-adjacent services, private ranges, link-local addresses, and cloud metadata endpoints.

\n

That second layer matters. URL parsing is full of representations, redirects, DNS behavior, proxies, and disagreement between libraries. The OWASP SSRF prevention guidance recommends network controls in addition to application checks for exactly this reason.

\n

The old code made one policy decision and then delegated navigation to a general-purpose HTTP client.

\n

The new code kept policy in the loop.

\n

2. Localhost stopped pretending to be authentication

\n

The debug renderer route was removed from production.

\n

The ordinary rendering API moved behind a separate service identity and required a short-lived, audience-bound token. Requests arriving merely from loopback or the cluster network were no longer considered trusted.

\n

The renderer also moved into a more restricted container:

\n
read-only root filesystem\nno cloud instance metadata route\nno general outbound internet access\nminimal object-store permission\nno shell package in runtime image\nCPU and wall-clock limits per render
\n

A service should be able to survive the caller making a mistake.

\n

“Only internal systems can reach this” is useful context. It is not authorization.

\n

3. The URL became an argument, not a program

\n

The renderer replaced exec() with a direct process invocation and an argument array:

\n
import { spawn } from \"node:child_process\";\nimport { randomUUID } from \"node:crypto\";\n\napp.post(\"/render\", requireServiceIdentity, (req, res) => {\n  const target = validateRenderUrl(req.body.url);\n  const width = validateWidth(req.body.width);\n  const output = `/tmp/${randomUUID()}.png`;\n\n  const child = spawn(\n    process.execPath,\n    [\n      \"capture.js\",\n      \"--url\", target,\n      \"--width\", String(width),\n      \"--output\", output,\n    ],\n    {\n      shell: false,\n      timeout: 20_000,\n      stdio: [\"ignore\", \"ignore\", \"pipe\"],\n    },\n  );\n\n  child.on(\"close\", (code) => {\n    if (code !== 0) {\n      return res.status(502).json({ error: \"render_failed\" });\n    }\n\n    res.sendFile(output);\n  });\n});
\n

The important part is not spawn as a magic safe word. It is that the URL is passed as one argument to one program, without a shell being asked to reinterpret it.

\n

The route still validates the URL, width, timeout, and output path. Removing the shell closes the command-injection class; input validation and sandboxing limit the damage from whatever the renderer itself might do.

\n

Security patches work better when they do not require one line of code to be perfect.

\n

Retesting the chain

\n

The patched mobile endpoint returned previews again on August 18.

\n

The original public test URL still worked.

\n

A public-to-public redirect worked, up to the new three-hop limit.

\n

A public URL redirecting to loopback failed before the second request:

\n
{\n  \"error\": \"url_not_allowed\",\n  \"reason\": \"redirect_destination_not_public\"\n}
\n

My loopback service received nothing.

\n

I tried an ordinary hostname that resolved to a public address and then changed. The connection was rejected when the actual destination no longer matched the validated address.

\n

The old internal /debug/render route returned 404 from the renderer image and was unreachable from the preview network anyway.

\n

Finally, $COMPANY supplied a test fixture containing the characters that had previously changed the shell command. The renderer treated the entire value as one invalid URL argument and returned a normal validation error.

\n

No canary request arrived.

\n

No timing shift appeared.

\n

The preview failed.

\n

This time the command failed with it.

\n

The regression tests that describe the real boundary

\n

The most useful tests were not named after my payload. They were named after the properties the system had forgotten.

\n
def test_preview_revalidates_every_redirect_destination():\n    public = controlled_server.redirect_to(\"http://127.0.0.1:3001/\")\n\n    result = create_mobile_preview(url=public)\n\n    assert result.status == 400\n    assert result.reason == \"redirect_destination_not_public\"\n    assert controlled_loopback_service.requests == []
\n
test(\"renderer passes URL as one argument without a shell\", async () => {\n  const suspicious = makeStringContainingShellSyntax();\n\n  await expect(render(suspicious)).rejects.toMatchObject({\n    code: \"INVALID_RENDER_URL\",\n  });\n\n  expect(spawn).not.toHaveBeenCalledWith(\n    expect.anything(),\n    expect.anything(),\n    expect.objectContaining({ shell: true }),\n  );\n});
\n

And the infrastructure test mattered as much as either unit test:

\n
preview-worker → public HTTP/HTTPS: allowed through controlled egress\npreview-worker → loopback/private/link-local/metadata: denied\nrenderer       → arbitrary internet: denied\nrenderer       → preview object bucket: write-only, scoped prefix
\n

A fixed payload is one regression test.

\n

A fixed trust model is a system of them.

\n

The three assumptions in the exploit

\n

No individual mistake felt large enough to become critical.

\n

The URL validator blocked private addresses.

\n

The renderer listened only on loopback.

\n

The command put the URL inside quotes.

\n

Each sentence sounds like a mitigation.

\n

Together they produced RCE.

\n

“We block internal URLs”

\n

The service blocked the URL the user supplied. It did not block the URL the HTTP client eventually fetched.

\n

Validation attached to a string instead of to the network action.

\n

“The endpoint is only on localhost”

\n

That was true from the network’s point of view.

\n

It was false from the attacker’s point of view because another reachable service could be instructed to make the request.

\n

Reachability composes.

\n

“The value is quoted”

\n

Quoting is part of shell grammar, not an alternative to it.

\n

Once a shell receives a command string containing untrusted text, correctness depends on every transformation preserving syntax exactly. The safer design is not to ask a shell to parse the value at all.

\n

The exploit did not defeat three strong defenses.

\n

It passed through three defenses that protected different objects from the ones developers thought they protected.

\n

The report closed

\n

$COMPANY closed the report on August 24 after the mobile clients had resumed preview generation and the infrastructure changes had reached production.

\n

The reward was $BOUNTY. The amount matters less than the severity classification, and the severity matters less than the patch surviving the feature being turned back on.

\n

The engineer who handled the report sent one final note:

\n
\n

We originally treated the redirect check, renderer authentication, and shell invocation as separate issues. The incident review now models them as one request path.

\n
\n

That is the right lesson.

\n

Vulnerabilities are often reviewed one function at a time because code is stored one function at a time. Attackers get the whole request path.

\n

In February, a PDF button reminded me that reachability is not authorization.

\n

In June, SAML reminded me that authentication is not tenancy.

\n

This one added a smaller rule:

\n

A redirect is a new request, not a footnote to the old one.

\n

The first URL was public.

\n

The second URL was localhost.

\n

The third value became shell syntax.

\n

Every component did something it had been designed to do:

\n\n

The vulnerability lived in the word therefore between those sentences.

\n

No command ran on the phone.

\n

No firewall port opened to the internet.

\n

No cryptography failed.

\n

I pasted a link into a mobile app.

\n

The app said the preview failed.

\n

The server ran the rest.

","timeToRead":18,"frontmatter":{"title":"The preview failed. The command did not.","date":"August 26, 2023","description":"A mobile app's link-preview endpoint followed one redirect into localhost, reached an internal screenshot service, and turned a blocked SSRF into remote command execution."}}},"pageContext":{"slug":"/the-preview-failed-the-command-did-not/","previous":{"fields":{"slug":"/the-signature-was-valid-the-company-was-wrong/"},"frontmatter":{"title":"The signature was valid. The company was wrong"}},"next":{"fields":{"slug":"/the-cookie-was-httponly-the-session-was-not/"},"frontmatter":{"title":"The cookie was HttpOnly. The session was not."}}}}, "staticQueryHashes": ["3037286347","63159454"]}