Merge pull request #202 from NEOS-AI/dev

Learn more details for better Postgres based search engine

postgres/electric/README.md

@@ -0,0 +1,11 @@
+# Electric
+
+[Electric](https://github.com/electric-sql/electric) is a Postgres sync engine. It does real-time partial replication of Postgres data into local apps and services.
+
+## Running Insturction
+
+### Docker
+
+```bash
+docker compose -f docker_compose/docker-compose.yml up
+```

postgres/electric/docker_compose/docker-compose.yml

@@ -0,0 +1,32 @@
+version: "3.3"
+name: "electric_example-${PROJECT_NAME:-default}"
+
+services:
+  postgres:
+    image: postgres:16-alpine
+    environment:
+      POSTGRES_DB: electric
+      POSTGRES_USER: postgres
+      POSTGRES_PASSWORD: password
+    ports:
+      - 54321:5432
+    volumes:
+      - ./postgres.conf:/etc/postgresql/postgresql.conf:ro
+    tmpfs:
+      - /var/lib/postgresql/data
+      - /tmp
+    command:
+      - postgres
+      - -c
+      - config_file=/etc/postgresql/postgresql.conf
+
+  backend:
+    image: electricsql/electric:canary
+    environment:
+      DATABASE_URL: postgresql://postgres:password@postgres:5432/electric?sslmode=disable
+    ports:
+      - 3000:3000
+    build:
+      context: ../packages/sync-service/
+    depends_on:
+      - postgres

postgres/electric/docker_compose/postgres.conf

@@ -0,0 +1,2 @@
+listen_addresses = '*'
+wal_level = logical      # minimal, replica, or logical

postgres/paradedb/README.md

@@ -77,3 +77,22 @@ paradedb/paradedb
 If you want to customize the values, please refer [ParadeDB Docs](https://github.com/paradedb/charts/tree/main/charts/paradedb).
 
 For more information, please refer to the [ParadeDB github repo](https://github.com/paradedb/charts).
+
+## See details of Stored Procedures
+
+ParadeDB provides a set of stored procedures for searching and indexing.
+In psql, you could run `\df+ <function_name> ` to see the details of the stored procedure.
+
+Also, you could run the query below to print out all stored procedures in the database:
+```bash
+sudo docker exec paradedb psql -U postgres -d postgres -c "
+SELECT
+    n.nspname as schema_name,
+    p.proname as procedure_name,
+    pg_get_functiondef(p.oid) as definition
+FROM pg_proc p
+INNER JOIN pg_namespace n ON p.pronamespace = n.oid
+WHERE n.nspname NOT IN ('pg_catalog', 'information_schema')
+AND p.prokind = 'f'  -- Only select normal functions (not aggregate or window functions)
+ORDER BY schema_name, procedure_name;" > ./procedures_paradedb.sql
+```

postgres/paradedb/extract_all_stored_procedures.sh

@@ -0,0 +1,11 @@
+# Extract all stored procedures
+sudo docker exec paradedb psql -U postgres -d postgres -c "
+SELECT
+    n.nspname as schema_name,
+    p.proname as procedure_name,
+    pg_get_functiondef(p.oid) as definition
+FROM pg_proc p
+INNER JOIN pg_namespace n ON p.pronamespace = n.oid
+WHERE n.nspname NOT IN ('pg_catalog', 'information_schema')
+AND p.prokind = 'f'  -- Only select normal functions (not aggregate or window functions)
+ORDER BY schema_name, procedure_name;" > ./procedures_paradedb.sql