Skip to content

Conversation

@bebosudo
Copy link
Member

@bebosudo bebosudo commented Dec 3, 2025

  • This is a first pass on top of feat: Integrate aws batch policy into docs #941 to remove mentions of the nf-tower-aws repo from the AWS Batch setup page (there are still other mentions throughout other pages of the docs).
  • I restructured the page with common steps first and differences between automatic (forge) and manual batch setup instructions at the bottom.
  • I mentioned EFS and FSx as possible work dir options from the beginning, since they were hidden down among the details.
  • I updated all the AWS UI procedures to the new steps.
  • I started fixing the other docs page on how to setup Batch resources manually.

This was done on Cloud only for now, if it looks ok I'll replicate it into the enterprise Batch docs too.

@bebosudo bebosudo force-pushed the chiusole/cleanup-aws-batch-docs branch from 5dfb005 to 91936aa Compare December 9, 2025 11:59
@bebosudo
Copy link
Member Author

bebosudo commented Dec 9, 2025

It took me some time to find out the specific way to make EFS/FSx work with minimal permissions, and I documented the required Security Group changes. Unfortunately right now SGs can't be created from the Platform UI, so I added instructions on how to set them up from the AWS console.

edit: SG aren't supposed to be created from the UI, that's a frontend glitch, discussion

Co-authored-by: Justine Geffen <[email protected]>
Signed-off-by: Alberto Chiusole <[email protected]>
@justinegeffen justinegeffen added the 3. Reviews complete Reviews complete. Remove label when confirmed in prod. label Dec 17, 2025
@bebosudo bebosudo merged commit c8d6ec2 into chiusole/integrate-forge-policy-into-docs Dec 18, 2025
3 checks passed
@bebosudo bebosudo deleted the chiusole/cleanup-aws-batch-docs branch December 18, 2025 10:08
bebosudo added a commit that referenced this pull request Dec 22, 2025
* First pass at integrating aws batch policy into docs

* replace absolute links with relative

* Port AWS Batch policy breakdown to enterprise docs too

* replace github flavor of markdown admonition with docusaurus'

* Fix internal docs links

* Rename sections

* Replace some mentions of Forge

* Restructure AWS Batch page docs, remove nf-tower-aws mentions (#943)

* Restructure the AWS Batch page in cloud, remove mentions of external repo, start fixing manual batch page

* S3/EFS/FSx work dir must be in the same region as compute

* Expand instructions on how to setup EFS/FSx SG

* lowercase S3 bucket in section title

* Fix internal links

* Outbound EFS/FSx rules must allow 0./0

* Remove references to nf-tower-aws from cloud repo

* Document role to assume instead of attaching policy directly to user

* Apply suggestions from code review

Co-authored-by: Justine Geffen <[email protected]>
Signed-off-by: Alberto Chiusole <[email protected]>

* Update manual-aws-batch-setup.mdx

Signed-off-by: Justine Geffen <[email protected]>

---------

Signed-off-by: Alberto Chiusole <[email protected]>
Signed-off-by: Justine Geffen <[email protected]>
Co-authored-by: Justine Geffen <[email protected]>

* Port AWS Batch policy update from Platform Cloud to Enterprise Next

* Backport Batch IAM policy refactoring into v24+

* Fix links in v24.x pointing to data studios before rename to studios

* Create aws-batch-test.md

Signed-off-by: Justine Geffen <[email protected]>

* Delete platform-cloud/docs/compute-envs/aws-batch-test.md

Signed-off-by: Justine Geffen <[email protected]>

* Fix some more Data Studios links in old 24.x docs before renaming

* Fix various broken anchor references after updating aws batch docs

* Fix two more anchors who were hallucinated

* Fix some more anchors

* Hopefully last anchor fix

* Revert changes to EKS CE instructions [skip ci]

* Add warning about FSx being incompatible with Studios  (#979)

* Add warning about FSx workdir being incompatible with Studios like EFS

* Fix studios link in v24.x

---------

Signed-off-by: Alberto Chiusole <[email protected]>
Signed-off-by: Justine Geffen <[email protected]>
Co-authored-by: Justine Geffen <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

3. Reviews complete Reviews complete. Remove label when confirmed in prod.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants