arxiv-preflight
arXiv Preflight
Submission-readiness review for a manuscript before arXiv upload. The goal is not to judge whether a paper was AI-written from style. The goal is to find concrete, locatable, reviewable evidence of unchecked LLM output, hallucinated references, placeholder data, unsupported claims, and arXiv-policy risks — and to hand the author a fix list.
Anchor on the actual arXiv stance: authors may use generative AI tools but are fully responsible for the content and must disclose significant use per field norms; AI tools cannot be listed as authors. See references/arxiv_policy_notes.md for the exact language.
This skill is intentionally platform-neutral. It should work for any AI coding/review agent that can read files and run local Python scripts; it does not require OpenAI-specific UI metadata.
Requires Python 3.9+.
Workflow
-
Identify inputs. Ask for or detect: LaTeX project directory, single PDF, BibTeX file, supplementary figures/tables, or experiment data. Prefer LaTeX source over rendered PDF — PDF text extraction loses structure and produces noisier reference checks.
-
Extract manuscript text. Run
scripts/extract_manuscript_text.pyon the input. It merges\input/\include, strips LaTeX commands while preserving section/figure/table/citation keys, and falls back to PDF text extraction. Output:manuscript.jsonwithsections,figures,tables,cite_keys,numbers, andwarnings. Treat unresolved or skipped includes as review risks. -
Hard-red-line scan. Run
scripts/scan_ai_artifacts.pyagainst the extracted text. It flags LLM meta-comments, prompt residue, placeholder content, TODO/TBD/XX%, and AI-listed-as-author. Patterns live inreferences/ai_artifact_patterns.md— extend the list when the user reports new failure modes. Any hit is aBLOCKERunless the user explicitly justifies it.