Skip to content

Jmercer/complete plugin sync fix #6527

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 8 commits into
base: master
Choose a base branch
from
Open

Jmercer/complete plugin sync fix #6527

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
8 commits
Select commit Hold shift + click to select a range
d645e75
fix: use PAT for reading from influxdb3_plugins
MeelahMe Nov 10, 2025
df8d5f8
fix: combine PAT and path fixes for plugin sync
MeelahMe Nov 10, 2025
a8a2b42
Merge branch 'master' into jmercer/complete-plugin-sync-fix
MeelahMe Nov 10, 2025
e18e2a1
debug: add file structure inspection to identify path issue
MeelahMe Nov 14, 2025
00d233a
Merge branch 'master' into jmercer/complete-plugin-sync-fix
MeelahMe Nov 14, 2025
930bb70
fix: correct relative path to influxdb3_plugins dir
MeelahMe Nov 14, 2025
9d1ce68
fix: correct relative path depth in docs_mapping.yaml
MeelahMe Nov 14, 2025
e0d56ad
fix: added npm install playwrite
MeelahMe Nov 14, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
114 changes: 102 additions & 12 deletions .github/workflows/sync-plugins.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -80,11 +80,15 @@ jobs:
token: ${{ secrets.GITHUB_TOKEN }}

- name: Checkout influxdb3_plugins (sparse)
run: |
git clone --filter=blob:none --sparse https://github.com/influxdata/influxdb3_plugins.git .ext/influxdb3_plugins
cd .ext/influxdb3_plugins
git sparse-checkout set influxdata/ scripts/
git checkout ${{ steps.inputs.outputs.source_commit }}
uses: actions/checkout@v4
with:
repository: influxdata/influxdb3_plugins
token: ${{ secrets.PLUGINS_CONTENT_READ_TOKEN }}
path: .ext/influxdb3_plugins
sparse-checkout: |
influxdata/
scripts/
ref: ${{ steps.inputs.outputs.source_commit }}

- name: Setup Node.js
uses: actions/setup-node@v4
Expand Down Expand Up @@ -172,24 +176,109 @@ jobs:

core.setFailed('Plugin validation failed');

- name: Debug - Check file structure
if: steps.validate.outputs.validation_passed == 'true'
run: |
echo "======================================"
echo "DEBUG: Checking file structure"
echo "======================================"
echo ""

echo "1. Current working directory:"
pwd
echo ""

echo "2. List workspace root:"
ls -la
echo ""

echo "3. Check if .ext exists:"
if [ -d ".ext" ]; then
echo "✅ .ext directory exists"
ls -la .ext/
else
echo "❌ .ext directory NOT found"
fi
echo ""

echo "4. Check if .ext/influxdb3_plugins exists:"
if [ -d ".ext/influxdb3_plugins" ]; then
echo "✅ .ext/influxdb3_plugins exists"
ls -la .ext/influxdb3_plugins/
else
echo "❌ .ext/influxdb3_plugins NOT found"
fi
echo ""

echo "5. Check if influxdata directory exists:"
if [ -d ".ext/influxdb3_plugins/influxdata" ]; then
echo "✅ influxdata directory exists"
ls -la .ext/influxdb3_plugins/influxdata/
else
echo "❌ influxdata directory NOT found"
fi
echo ""

echo "6. Check if basic_transformation exists:"
if [ -d ".ext/influxdb3_plugins/influxdata/basic_transformation" ]; then
echo "✅ basic_transformation directory exists"
ls -la .ext/influxdb3_plugins/influxdata/basic_transformation/
else
echo "❌ basic_transformation directory NOT found"
fi
echo ""

echo "7. Now checking from script directory:"
cd docs-v2/helper-scripts/influxdb3-plugins
echo "Current directory:"
pwd
echo ""

echo "8. Trying to access with ../../../.ext/influxdb3_plugins:"
if [ -d "../../../.ext/influxdb3_plugins" ]; then
echo "✅ Can access via ../../../.ext/influxdb3_plugins"
ls -la ../../../.ext/influxdb3_plugins/
else
echo "❌ Cannot access via ../../../.ext/influxdb3_plugins"
fi
echo ""

echo "9. Checking all possible paths from script dir:"
echo "Checking ../.ext/influxdb3_plugins:"
ls -la ../.ext/influxdb3_plugins/ 2>&1 || echo "❌ Not found"
echo ""
echo "Checking ../../.ext/influxdb3_plugins:"
ls -la ../../.ext/influxdb3_plugins/ 2>&1 || echo "❌ Not found"
echo ""
echo "Checking ../../../.ext/influxdb3_plugins:"
ls -la ../../../.ext/influxdb3_plugins/ 2>&1 || echo "❌ Not found"
echo ""
echo "Checking ../../../../.ext/influxdb3_plugins:"
ls -la ../../../../.ext/influxdb3_plugins/ 2>&1 || echo "❌ Not found"
echo ""

echo "======================================"
echo "DEBUG: Complete"
echo "======================================"

- name: Transform plugin documentation
if: steps.validate.outputs.validation_passed == 'true'
run: |
cd docs-v2

# Set PLUGIN_DIR for the transformation script
export INFLUXDB3_PLUGINS_PATH=".ext/influxdb3_plugins"

cd docs-v2/helper-scripts/influxdb3-plugins
# Set path to plugins repo (relative from script directory)
export INFLUXDB3_PLUGINS_PATH="../../../.ext/influxdb3_plugins"
# Run the transformation
if [[ "${{ steps.inputs.outputs.plugins }}" == "all" ]]; then
node helper-scripts/influxdb3-plugins/port_to_docs.js
node port_to_docs.js # ← CHANGE: Script is in current dir now
else
# Transform specific plugins
IFS=',' read -ra PLUGIN_ARRAY <<< "${{ steps.inputs.outputs.plugins }}"
for plugin in "${PLUGIN_ARRAY[@]}"; do
plugin=$(echo "$plugin" | xargs) # trim whitespace
echo "Transforming plugin: $plugin"
node helper-scripts/influxdb3-plugins/port_to_docs.js --plugin "$plugin"
node port_to_docs.js --plugin "$plugin"
done
fi

Expand All @@ -201,6 +290,7 @@ jobs:
- name: Setup Playwright
run: |
cd docs-v2
npm install playwright
npx playwright install chromium

- name: Generate screenshots
Expand Down
22 changes: 11 additions & 11 deletions helper-scripts/influxdb3-plugins/docs_mapping.yaml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -3,79 +3,79 @@

plugins:
basic_transformation:
source: ../../.ext/influxdb3_plugins/influxdata/basic_transformation/README.md
source: ../../../.ext/influxdb3_plugins/influxdata/basic_transformation/README.md
target: ../../content/shared/influxdb3-plugins/plugins-library/official/basic-transformation.md
category: official
additional_sections:
- schema_requirements
- logging

downsampler:
source: ../../.ext/influxdb3_plugins/influxdata/downsampler/README.md
source: ../../../.ext/influxdb3_plugins/influxdata/downsampler/README.md
target: ../../content/shared/influxdb3-plugins/plugins-library/official/downsampler.md
category: official
additional_sections:
- schema_management
- logging

forecast_error_evaluator:
source: ../../.ext/influxdb3_plugins/influxdata/forecast_error_evaluator/README.md
source: ../../../.ext/influxdb3_plugins/influxdata/forecast_error_evaluator/README.md
target: ../../content/shared/influxdb3-plugins/plugins-library/official/forecast-error-evaluator.md
category: official
additional_sections:
- logging

influxdb_to_iceberg:
source: ../../.ext/influxdb3_plugins/influxdata/influxdb_to_iceberg/README.md
source: ../../../.ext/influxdb3_plugins/influxdata/influxdb_to_iceberg/README.md
target: ../../content/shared/influxdb3-plugins/plugins-library/official/influxdb-to-iceberg.md
category: official
additional_sections:
- logging

mad_check:
source: ../../.ext/influxdb3_plugins/influxdata/mad_check/README.md
source: ../../../.ext/influxdb3_plugins/influxdata/mad_check/README.md
target: ../../content/shared/influxdb3-plugins/plugins-library/official/mad-check.md
category: official
additional_sections:
- logging

notifier:
source: ../../.ext/influxdb3_plugins/influxdata/notifier/README.md
source: ../../../.ext/influxdb3_plugins/influxdata/notifier/README.md
target: ../../content/shared/influxdb3-plugins/plugins-library/official/notifier.md
category: official
additional_sections:
- logging

prophet_forecasting:
source: ../../.ext/influxdb3_plugins/influxdata/prophet_forecasting/README.md
source: ../../../.ext/influxdb3_plugins/influxdata/prophet_forecasting/README.md
target: ../../content/shared/influxdb3-plugins/plugins-library/official/prophet-forecasting.md
category: official
additional_sections:
- logging

state_change:
source: ../../.ext/influxdb3_plugins/influxdata/state_change/README.md
source: ../../../.ext/influxdb3_plugins/influxdata/state_change/README.md
target: ../../content/shared/influxdb3-plugins/plugins-library/official/state-change.md
category: official
additional_sections:
- logging

stateless_adtk_detector:
source: ../../.ext/influxdb3_plugins/influxdata/stateless_adtk_detector/README.md
source: ../../../.ext/influxdb3_plugins/influxdata/stateless_adtk_detector/README.md
target: ../../content/shared/influxdb3-plugins/plugins-library/official/stateless-adtk-detector.md
category: official
additional_sections:
- logging

system_metrics:
source: ../../.ext/influxdb3_plugins/influxdata/system_metrics/README.md
source: ../../../.ext/influxdb3_plugins/influxdata/system_metrics/README.md
target: ../../content/shared/influxdb3-plugins/plugins-library/official/system-metrics.md
category: official
additional_sections:
- logging

threshold_deadman_checks:
source: ../../.ext/influxdb3_plugins/influxdata/threshold_deadman_checks/README.md
source: ../../../.ext/influxdb3_plugins/influxdata/threshold_deadman_checks/README.md
target: ../../content/shared/influxdb3-plugins/plugins-library/official/threshold-deadman-checks.md
category: official
additional_sections:
Expand Down