PDF to Markdown: Clean Markdown and Chunks for LLMs

{
  "url": "https://arxiv.org/pdf/1706.03762",
  "finalUrl": "https://arxiv.org/pdf/1706.03762",
  "status": "complete",
  "title": "Attention Is All You Need",
  "pageCount": 15,
  "pagesProcessed": 15,
  "pagesTruncated": false,
  "markdown": "<!-- page 1 -->\n\n…\n\n# Attention Is All You Need\n\n…\n\n<!-- page 2 -->\n\n## 1 Introduction\n\nRecurrent neural networks, long short-term memory [13] and gated recurrent [7] neural networks …",
  "markdownUrl": null,
  "charCount": 41793,
  "tokenEstimate": 10449,
  "tables": [
    {
      "index": 1,
      "page": 6,
      "rows": 6,
      "columns": 4,
      "markdown": "| Layer Type | Complexity per Layer | Sequential | Maximum Path Length |\n| --- | --- | --- | --- |\n…",
      "cells": [["Layer Type", "Complexity per Layer", "Sequential", "Maximum Path Length"], ["Self-Attention", "2 · O(n d)", "O(1)", "O(1)"]]
    }
  ],
  "chunks": [
    {
      "index": 8,
      "text": "### 3.2 Attention\n\nAn attention function can be described as mapping a query and a set of key-value pairs to an output …",
      "pageStart": 3,
      "pageEnd": 4,
      "headingPath": ["Attention Is All You Need", "3 Model Architecture", "3.2 Attention"],
      "tokens": 136,
      "charCount": 543
    }
  ],
  "chunkSize": 500,
  "ocrUsed": false,
  "textPages": 15,
  "ocrPages": 0,
  "ocrLanguages": null,
  "pages": [
    { "pageNumber": 1, "method": "text", "charCount": 2886, "tables": 0, "ocrConfidence": null, "error": null }
  ],
  "fileSizeBytes": 2215244,
  "contentType": "application/pdf",
  "metadata": { "creator": "LaTeX with hyperref", "producer": "pdfTeX-1.40.25", "pdfVersion": "1.5" },
  "encrypted": false,
  "error": null,
  "warnings": [],
  "fetchedAt": "2026-10-15T18:15:47.458Z",
  "processedAt": "2026-10-15T18:15:47.633Z"
}