diff --git a/docs/reference/cli.md b/docs/reference/cli.rst
similarity index 52%
rename from docs/reference/cli.md
rename to docs/reference/cli.rst
index fdd1b76b3..b87c258b8 100644
--- a/docs/reference/cli.md
+++ b/docs/reference/cli.rst
@@ -1,9 +1,9 @@
-# Command-Line Interface
+Command-Line Interface
+======================
 
 Full reference for the CLI:
 
-```{eval-rst}
+
 .. click:: blueapi.cli:main
-   :prog: blueapi
+      :prog: blueapi
    :show-nested:
-```
diff --git a/docs/reference/rest-spec.md b/docs/reference/rest-spec.rst
similarity index 81%
rename from docs/reference/rest-spec.md
rename to docs/reference/rest-spec.rst
index 23e45a04c..ded888033 100644
--- a/docs/reference/rest-spec.md
+++ b/docs/reference/rest-spec.rst
@@ -1,9 +1,8 @@
-# REST Specification
+REST Specification
+==================
 
 Blueapi runs a FastAPI server through which the blueapi worker can be
 interacted with. This page documents all possible endpoints of this
 server.
 
-```{eval-rst}
 .. openapi:: ./openapi.yaml
-```