QA. Merge into `trunk` #3499

mishautkin · 2025-07-02T09:07:07Z

Description

qa branch contains numerous updates for

automated env setup scripts;
/tests/qa dir with autotests;
/tests/qa-legacy-ui dir with autotests.

…l-payments into qa-pay-later-messaging

QA Update PLM

Add PLM default UI test

QA - Add test `Settings - Pay Later Messaging - Disabled on all pages`

- Add test data file - Add separate subtests for each data variation - Add resulting tests according to Xray - Add helper methods to save and retreive results of subtests

Add tests for PLM configurator

* A function has been created to check and verify the console messages for badgeBoxUtils.js * Test data has been created badges-per-country.data.ts file * Test case updated to test countries included in the test data * Fix lint issues

Settings - Onboarding - Default UI test updated.

* Test for Croatia and UK removed as it is included in the first test block. * Test data for Croatia and UK removed from test data file. * Test keys updated with actual test keys from Jira

* To have a more generic approach for enabling and disabling the advanced connection options enableConnectionOptionsToggle() function created. * toggleManuallyConnect and toggleSandboxMode update accordingly.

QA- updates and fixes

* Test cases in serial block reordered. * Some steps added to the test cases to prevent failure.

…-test Qa - update visual default UI test

Some tests were removed as they are going to be automated under PCP-4318

Add test PCP-4318 Remove the tests that are in scope of PCP-4318

QA/Add test pcp 4315/4316

Some tests were removed as they are going to be automated under PCP-4318

- Update playwright-utils version in package.json - Uncomment woocommerce.setup

…l-payments into qa-fix-legacy-ui

Qa fix legacy UI

mishautkin · 2025-09-04T08:02:35Z

@Dinamiko @puntope @AlexP11223 I'm done with the changes. Readme are updated, .zip files are there now. The scripts work on my side. Could you please review and try out the scripts?

puntope · 2025-09-05T14:50:40Z

If the site is MultiSite (the default config for project DDEV env) tests will fail.
Also if I deactivate the multisite in my environment and perform the test against the environment created by the repo the foundation tests fails.

You can check this error by:

cloning the repo (using this branch)
npm run ddev:setup
Remove lines in .ddev/wordpress/wp-config.php regarding multisite
cd tests/qa
npm run setup:tests
npm run all

Maybe we can add in the README that the environment set in the .env should not be a fresh WordPress Single site and not the one created using ddev:setup

puntope · 2025-09-05T16:44:18Z

Lots of tests are based on snapshots. But we didn't commit the snapshots. We should commit these snapshots as well.

puntope · 2025-09-05T17:38:45Z

Talking about snapshots again, I'm a bit curious about Snapshot-based E2E testing. What is the rationale behind using them?

puntope · 2025-09-05T17:54:47Z

03-Plugin Settings Tests are timing out for me. If they work for you, maybe is something not correctly setup in my env?

puntope · 2025-09-05T17:56:58Z

Have we considered using wp-env for running the E2E tests?

Here is an example how to use wp-env to run the E2E. The good thing about it is that it's ephemeral, and all the devs and also GitHub bots can even use the same standard environment for E2E tests. It's very easy to install (just a dependency)

You can also load your own plugins or logic easily to manipulate the environment and connect it to WPCLI etc It's widely used in Woo ecosystem

The same goes for Integration testing

cc: @Dinamiko

mishautkin · 2025-09-11T16:42:17Z

Hi, @puntope, I've disabled many visual tests and commited the screenshots for some which are more stable. There are still some failing tests but it would be nice to try running against the wp-env or Kinsta, since our current SSEs are a bit slow and may cause problems by themselves.

puntope

Let merge as it's. I can use this as fundational and create the wp-env version from there.

mishautkin and others added 30 commits March 6, 2025 19:18

Merge branch 'qa' of https://github.com/woocommerce/woocommerce-paypa…

2ff46aa

…l-payments into qa-pay-later-messaging

Merge pull request #3184 from woocommerce/qa-pay-later-messaging

5f53a56

QA Update PLM

Add PLM default UI test

80d938a

Merge pull request #3187 from woocommerce/qa-plm-default-ui

24a1103

Add PLM default UI test

Add test Settings - Pay Later Messaging - Disabled on all pages

2834771

Merge pull request #3188 from woocommerce/qa-pml-disable-on-all-pages

ed5ec85

QA - Add test `Settings - Pay Later Messaging - Disabled on all pages`

Add tests for PLM configurator

0790a94

- Add test data file - Add separate subtests for each data variation - Add resulting tests according to Xray - Add helper methods to save and retreive results of subtests

Fix beforeAll, function name and lint issues

d4d4526

Merge pull request #3191 from woocommerce/qa-plm-configurator-tests

77dff38

Add tests for PLM configurator

Fix learn more links - Italy

1708a2a

Settings - Onboarding - Default UI test updated.

5425891

* A function has been created to check and verify the console messages for badgeBoxUtils.js * Test data has been created badges-per-country.data.ts file * Test case updated to test countries included in the test data * Fix lint issues

.only removed

c8ae012

fix: var name changed

6084d9c

fix: var name changed in spec file

f36c20b

fix: the test data file name changed

42f5ec8

Merge pull request #3206 from woocommerce/qa-update-default-ui-test

8c411f1

Settings - Onboarding - Default UI test updated.

Fix and updates

77f0387

* Test for Croatia and UK removed as it is included in the first test block. * Test data for Croatia and UK removed from test data file. * Test keys updated with actual test keys from Jira

Unsued import removed

abe55eb

Update in functions

d4958cd

* To have a more generic approach for enabling and disabling the advanced connection options enableConnectionOptionsToggle() function created. * toggleManuallyConnect and toggleSandboxMode update accordingly.

camelCase used in var name

6e17611

Merge pull request #3209 from woocommerce/sedat-work

052898a

QA- updates and fixes

A missing step added to Learn more links test case

c2cc0aa

Updates

4550149

* Test cases in serial block reordered. * Some steps added to the test cases to prevent failure.

Merge pull request #3215 from woocommerce/qa-update-visual-default-ui…

e421aa7

…-test Qa - update visual default UI test

Add test PCP-4315 and PCP-4316.

df1a7cd

Some tests were removed as they are going to be automated under PCP-4318

Fix lint issues

094efdf

Add test and remove unnecessary ones

8e214c7

Add test PCP-4318 Remove the tests that are in scope of PCP-4318

Fix lint issues

6131881

Merge pull request #3220 from woocommerce/qa-pcp-4315/4316

9fac39f

QA/Add test pcp 4315/4316

Add test PCP-4315 and PCP-4316.

7aaa513

Some tests were removed as they are going to be automated under PCP-4318

mishautkin and others added 9 commits September 3, 2025 10:19

Update README.md

bf45a3b

Un-gitignore auxiliary .zip files in tests/qa and tests/qa-legacy-ui

187dc36

Updated README.md

43ef541

Lint js and md fixes

a213d39

General updates

5b9fccc

- Update playwright-utils version in package.json - Uncomment woocommerce.setup

Un-gitignore .zip files in resources/files

47e4ee0

Merge branch 'qa' of https://github.com/woocommerce/woocommerce-paypa…

db6bb25

…l-payments into qa-fix-legacy-ui

Merge pull request #3632 from woocommerce/qa-fix-legacy-ui

512a863

Qa fix legacy UI

Update playwright-utils to v2.7.2

78aaf66

mishautkin changed the base branch from trunk to develop September 8, 2025 13:06

mishautkin added 6 commits September 9, 2025 12:08

Remove Percy vars from .env.example

fa4b510

Add .fixme to 03-plugin-settings tests

de37039

Add docs/, refactor main README

c01fcce

Add .fixme to onboarding-badges visual tests

ed77cf7

Administrative updates

c08756d

Un-gitignore screenshots for onboarding tests

f68cb66

Add new versions of PCP and WC Subscriptions plugins

b469d35

puntope approved these changes Sep 15, 2025

View reviewed changes

mishautkin added 3 commits September 17, 2025 11:13

Update playwright-utils to v2.7.3

67dd6d8

Fix onboarding-ui.spec

8ca1cef

Add comments

fb43436

Dinamiko merged commit da009ae into develop Sep 17, 2025
7 checks passed

Dinamiko deleted the qa branch September 17, 2025 09:27

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

QA. Merge into `trunk` #3499

QA. Merge into `trunk` #3499

Uh oh!

mishautkin commented Jul 2, 2025

Uh oh!

mishautkin commented Sep 4, 2025 •

edited

Loading

Uh oh!

puntope commented Sep 5, 2025 •

edited

Loading

Uh oh!

puntope commented Sep 5, 2025 •

edited

Loading

Uh oh!

puntope commented Sep 5, 2025

Uh oh!

puntope commented Sep 5, 2025 •

edited

Loading

Uh oh!

puntope commented Sep 5, 2025 •

edited

Loading

Uh oh!

mishautkin commented Sep 11, 2025

Uh oh!

puntope left a comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

QA. Merge into trunk #3499

QA. Merge into trunk #3499

Uh oh!

Conversation

mishautkin commented Jul 2, 2025

Description

Uh oh!

mishautkin commented Sep 4, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

puntope commented Sep 5, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

puntope commented Sep 5, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

puntope commented Sep 5, 2025

Uh oh!

puntope commented Sep 5, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

puntope commented Sep 5, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

mishautkin commented Sep 11, 2025

Uh oh!

puntope left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

QA. Merge into `trunk` #3499

QA. Merge into `trunk` #3499

mishautkin commented Sep 4, 2025 •

edited

Loading

puntope commented Sep 5, 2025 •

edited

Loading

puntope commented Sep 5, 2025 •

edited

Loading

puntope commented Sep 5, 2025 •

edited

Loading

puntope commented Sep 5, 2025 •

edited

Loading