Commit Graph

29 Commits

Author SHA1 Message Date
Abhijeet
1cda053bf3
feat: Add signature verification for tenant feature flags (#28053)
## Description
PR to add the signature verification for tenant feature flags. With this
PR we will make sure feature flags those are getting reported from CS
can't be mocked.

#### PR fixes following issue(s)
Fixes https://github.com/appsmithorg/cloud-services/issues/1394

#### Type of change
- New feature (non-breaking change which adds functionality)

## Testing
#### How Has This Been Tested?
- [x] Manual
- [ ] JUnit
- [ ] Jest
- [ ] Cypress
>
>


## Checklist:
#### Dev activity
- [x] My code follows the style guidelines of this project
- [x] I have performed a self-review of my own code
- [x] I have commented my code, particularly in hard-to-understand areas
- [ ] I have made corresponding changes to the documentation
- [x] My changes generate no new warnings
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] PR is being merged under a feature flag


#### QA activity:
- [ ] [Speedbreak
features](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#speedbreakers-)
have been covered
- [ ] Test plan covers all impacted features and [areas of
interest](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#areas-of-interest-)
- [ ] Test plan has been peer reviewed by project stakeholders and other
QA members
- [ ] Manually tested functionality on DP
- [ ] We had an implementation alignment call with stakeholders post QA
Round 2
- [ ] Cypress test cases have been added and approved by SDET/manual QA
- [ ] Added `Test Plan Approved` label after Cypress tests were reviewed
- [ ] Added `Test Plan Approved` label after JUnit tests were reviewed
2023-10-14 15:14:17 +05:30
Saroj
48a3f15ab1
test: Bump cypress version to 13.3.1 (#27987)
## Description
 - Bumped cypress version
 - Updated workflow files to use latest cypress GitHub-action 

#### Type of change
- Workflow files
- Package.json
- yarn.lock
## Testing
>
#### How Has This Been Tested?
- [x] Cypress

---------

Co-authored-by: Aishwarya UR <aishwarya@appsmith.com>
2023-10-13 10:49:56 +05:30
akash-codemonk
3dc1241468
chore: get browser logs from failed cypress tests (#27724)
Fixes https://github.com/appsmithorg/appsmith/issues/26006

Get browser console logs for failed tests. This will help with easier
debugging of flaky tests.

Sample artifact for a test
https://github.com/appsmithorg/appsmith/suites/16856147292/artifacts/962768313
Latest test run of the change:
https://github.com/appsmithorg/appsmith/actions/runs/6405413689

Trimming down the files to a max of 10 files, since the artifact size
can go upto a GB when there are a 1000 or more tests failing.

---------

Co-authored-by: Aishwarya-U-R <91450662+Aishwarya-U-R@users.noreply.github.com>
Co-authored-by: Aishwarya UR <aishwarya@appsmith.com>
2023-10-05 14:42:30 +05:30
Saroj
20c5290c57
ci: Fix ci-test workflows (#27583)
## Description
- Fix ci-test workflows

#### Type of change
- Workflow files
## Testing
- CI run
2023-10-05 10:38:48 +05:30
Aishwarya-U-R
6fcf9b48c4
test: Cypess | Oracle DS validations added (Part 2) + CI Stabilize (#27282)
## Description
- This PR adds Oracle validations
- 'Add more' validated from Oracle Ds page
- Tc's automated Tc
[#2204](https://github.com/appsmithorg/TestSmith/issues/2204)
- Added a bit of sleep for keyboard actions (Enter, Escape, Delete)
- Added default param for datasources._host
- Oracle documentation verification added
- get cypress url dashboard url - step commented in ymls, as its no more
used
- Updating Slack message to also display the failing specs in notif
- ElasticSearch spec - update to check hosted run
- ServerSide/GenerateCRUD/MySQL2_Spec.ts - EntityExplore ds name miss
fix
- Update waitForServerRestart() timeout

#### Type of change
- Script fix (non-breaking change which fixes an issue)

## Testing

#### How Has This Been Tested?
- [X] Cypress CI runs

## Checklist:
#### QA activity:
- [X] Added `Test Plan Approved` label after Cypress tests were reviewed
2023-09-14 16:53:42 +05:30
Aishwarya-U-R
7985a551f6
test: Cypess | Oracle DS validations added (Part 1) + CI Stabilize (#27161)
## Description
- Adds validations for Oracle Ds to run in Hosted instance
- Trial fix for EmbedSettings/EmbedSettings_spec.js (checking the
Appsmith is starting page goes away on its own)
- Block_Execution.ts - updated to use Oracle mock data
- Oracle tests [TC
#2354](https://github.com/appsmithorg/TestSmith/issues/2354), [TC
#2355](https://github.com/appsmithorg/TestSmith/issues/2355), [TC
#2356](https://github.com/appsmithorg/TestSmith/issues/2356), [TC
#2357](https://github.com/appsmithorg/TestSmith/issues/2357) Automated
- Set Commit Message update for Hosted runs since now Airtable,
ElasticSearch are also part along with GSheet cases
- SMTP added verification on mail details (from, to, status, msg body
etc)
- Widgets/WidgetPropertySetters_spec.ts - Lint error case flaky fix

#### Type of change
- Script fix (non-breaking change which fixes an issue)

## Testing
>
#### How Has This Been Tested?
- [X] Cypress CI runs

## Checklist:
#### QA activity:
- [X] Added `Test Plan Approved` label after Cypress tests were reviewed
2023-09-13 22:33:14 +05:30
Aishwarya-U-R
2cd4555259
ci: Set Commit Message update (#27247)
## Description
- This PR fixes the PR runs where single quotes can be present in PR
desc

---------

Co-authored-by: Saroj <43822041+sarojsarab@users.noreply.github.com>
2023-09-13 13:25:52 +05:30
Saroj
5312ee11f3
test: Fix gsheet tests (#27146)
## Description
- Fix gsheet tests
- Fix workflows to not upload the result file in case of success

#### Type of change
- spec file changes
- Workflow file changes

## Testing
>
#### How Has This Been Tested?
- [x] Cypress


## Checklist:
#### QA activity:
- [ ] [Speedbreak
features](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#speedbreakers-)
have been covered
- [ ] Test plan covers all impacted features and [areas of
interest](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#areas-of-interest-)
- [ ] Test plan has been peer reviewed by project stakeholders and other
QA members
- [ ] Manually tested functionality on DP
- [ ] We had an implementation alignment call with stakeholders post QA
Round 2
- [ ] Cypress test cases have been added and approved by SDET/manual QA
- [ ] Added `Test Plan Approved` label after Cypress tests were reviewed
- [ ] Added `Test Plan Approved` label after JUnit tests were reviewed
2023-09-11 18:37:02 +05:30
Aishwarya UR
5a9e36604f fix Set Commit Message 2023-09-09 20:03:58 +05:30
Aishwarya UR
5ee798bf26 fix Set Commit Message 2023-09-09 20:01:23 +05:30
Aishwarya UR
c6c25c609c fix Set Commit Message 2023-09-09 19:58:00 +05:30
Aishwarya-U-R
1d442ed42b
ci: Set Commit Message fix (#27130)
## Description
- This PR fixes the Set Commit Message step for workflow runs
2023-09-09 19:52:04 +05:30
Aishwarya-U-R
e6742014b8
ci: Set Commit Message fix (#27128)
## Description
- This PR fixes the Set Commit Message for workflows runs in CI
2023-09-09 18:55:04 +05:30
Aishwarya-U-R
53ceefe9cc
test: Cypress | (DI) SMTP & Airtable validations + CI Stabilize (#26991)
## Description
- This PR fixes the flakyness with error message in
ConnectionErrors_spec
- This PR adds validations for SMTP plugin (added documentation
verification + email sent successfully)
- Updating the Cypress Dashboard for new links
- Improve Widgets/Image/Image2_Spec.ts
- Flaky fix BugTests/Bug26716_Spec.ts
- ShowAllDatasources() added for direct navigation to Action DS list
- Fix ServerSide/GenerateCRUD/Postgres2_Spec.ts
- DeleteDatasouceFromActiveTab() improved
- Airtable - added documentation verification
- Airtable - Added widget binding & deploy App verification of Api
records data
- Datasources/MongoDatasource_spec.js - js to ts definition
- /EmbedSettings/EmbedSettings_spec.js - server restart timeout
increased

#### Type of change
- Script update (non-breaking change which fixes an issue)

## Testing

#### How Has This Been Tested?
- [X] Cypress CI runs

## Checklist:
#### QA activity:
- [X] Added `Test Plan Approved` label after Cypress tests were reviewed
2023-09-08 14:42:27 +05:30
Saroj
d1fea6ba47
ci: Cypress rerun improvements (#27072)
## Description
- Cypress parallel run improvements
#### Type of change
- Workflow changes
## Testing
- Workflow run
2023-09-07 17:00:39 +05:30
Saroj
ba9ebf1d6e
ci: Migrate pending workflows to dime defenders (#26968)
## Description
- Updated the logic to use DimeDefenders spec split
- Updated ci-test-hosted, ci-test-limited and ci-test-custom-script
- Changes to handle when there is no spec to run in CI

#### Type of change
- DimeDefender script
- Workflows
## Testing
- Workflow run
2023-09-06 14:40:13 +05:30
Manish Kumar
f24f5d4304
chore: url changes of mocking flagsmith (#26804)
## Description
> TL;DR Complimentary changes utlising
`APPSMITH_CLOUD_SERVICES_SIGNATURE_BASE_URL` when mocking flagsmith on
cloud services

fetching the remote flags from cloud server, the the cacheableHelper
function retrieves base url for cloud services.
when running CI tests this base url is set to ted rather than the cloud
services. In order to get the docker hosted CS url which is provided by
this varialbe: `APPSMITH_CLOUD_SERVICES_SIGNATURE_BASE_URL` , we have to
use another method `getBaseUrlWithSignatureVerification` to get the
docker hosted CS url instead of `getBaseUrl` which gives TED url
#### PR fixes following issue(s)
Fixes #25787 

#### Type of change
- Chore: this may break EE sync

>
>
>
## Testing
>
#### How Has This Been Tested?
> Please describe the tests that you ran to verify your changes. Also
list any relevant details for your test configuration.
> Delete anything that is not relevant
- [ ] Manual
- [ ] JUnit
- [ ] Jest
- [ ] Cypress
>
>
#### Test Plan
> Add Testsmith test cases links that relate to this PR
>
>
#### Issues raised during DP testing
> Link issues raised during DP testing for better visiblity and tracking
(copy link from comments dropped on this PR)
>
>
>
## Checklist:
#### Dev activity
- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my own code
- [ ] I have commented my code, particularly in hard-to-understand areas
- [ ] I have made corresponding changes to the documentation
- [ ] My changes generate no new warnings
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] PR is being merged under a feature flag


#### QA activity:
- [ ] [Speedbreak
features](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#speedbreakers-)
have been covered
- [ ] Test plan covers all impacted features and [areas of
interest](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#areas-of-interest-)
- [ ] Test plan has been peer reviewed by project stakeholders and other
QA members
- [ ] Manually tested functionality on DP
- [ ] We had an implementation alignment call with stakeholders post QA
Round 2
- [ ] Cypress test cases have been added and approved by SDET/manual QA
- [ ] Added `Test Plan Approved` label after Cypress tests were reviewed
- [ ] Added `Test Plan Approved` label after JUnit tests were reviewed
2023-09-04 18:37:28 +05:30
Saroj
7b9ed8021e
ci: Fix non-duplicate specs rerun (#26796)
## Description
- Fix single spec rerun
#### PR fixes following issue(s)

#### Type of change
- Workflow change
#### How Has This Been Tested?
- CI runs
2023-08-30 18:21:48 +05:30
Saroj
d3f68b223f
ci: Fix internal db connection issue (#26731)
## Description
 - Fix internal db connection issue

#### Type of change
- cypress_hooks.js 
- Workflow changes
## Testing
- CI run
2023-08-29 16:45:49 +05:30
Saroj
2ec612c7aa
ci: Update ci-custom-script to unblock push workflows (#26699)
## Description
- Update ci-custom-script to unblock push workflows

#### Type of change
- Workflow changes
#### How Has This Been Tested?
- Workflow run
2023-08-28 17:12:32 +05:30
Saroj
edbbefd979
chore: Changes to enable internal cypress dashboard (#26626)
> Pull Request Template
>
> Use this template to quickly create a well written pull request.
Delete all quotes before creating the pull request.
>
## Description
> Add a TL;DR when description is extra long (helps content team)
>
> Please include a summary of the changes and which issue has been
fixed. Please also include relevant motivation
> and context. List any dependencies that are required for this change
>
> Links to Notion, Figma or any other documents that might be relevant
to the PR
>
>
#### PR fixes following issue(s)
Fixes # (issue number)
> if no issue exists, please create an issue and ask the maintainers
about this first
>
>
#### Media
> A video or a GIF is preferred. when using Loom, don’t embed because it
looks like it’s a GIF. instead, just link to the video
>
>
#### Type of change
> Please delete options that are not relevant.
- Bug fix (non-breaking change which fixes an issue)
- New feature (non-breaking change which adds functionality)
- Breaking change (fix or feature that would cause existing
functionality to not work as expected)
- Chore (housekeeping or task changes that don't impact user perception)
- This change requires a documentation update
>
>
>
## Testing
>
#### How Has This Been Tested?
> Please describe the tests that you ran to verify your changes. Also
list any relevant details for your test configuration.
> Delete anything that is not relevant
- [ ] Manual
- [ ] JUnit
- [ ] Jest
- [ ] Cypress
>
>
#### Test Plan
> Add Testsmith test cases links that relate to this PR
>
>
#### Issues raised during DP testing
> Link issues raised during DP testing for better visiblity and tracking
(copy link from comments dropped on this PR)
>
>
>
## Checklist:
#### Dev activity
- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my own code
- [ ] I have commented my code, particularly in hard-to-understand areas
- [ ] I have made corresponding changes to the documentation
- [ ] My changes generate no new warnings
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] PR is being merged under a feature flag


#### QA activity:
- [ ] [Speedbreak
features](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#speedbreakers-)
have been covered
- [ ] Test plan covers all impacted features and [areas of
interest](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#areas-of-interest-)
- [ ] Test plan has been peer reviewed by project stakeholders and other
QA members
- [ ] Manually tested functionality on DP
- [ ] We had an implementation alignment call with stakeholders post QA
Round 2
- [ ] Cypress test cases have been added and approved by SDET/manual QA
- [ ] Added `Test Plan Approved` label after Cypress tests were reviewed
- [ ] Added `Test Plan Approved` label after JUnit tests were reviewed
2023-08-25 10:21:12 +05:30
Valera Melnikov
826d58f813
chore:update node version to v18 (#26358)
## Description
Update node version

---------

Co-authored-by: Valera Melnikov <melnikov.vv@greendatasoft.ru>
2023-08-15 18:56:04 +05:30
Saroj
53e3890066
ci: Fix for artifact name to download (#25599)
## Description
- Fix for artifact name to download
#### Type of change
- Workflow changes
## Testing
>
#### How Has This Been Tested?
- Workflow run
2023-07-21 18:19:28 +05:30
Saroj
83f0f8fd96
ci: Upload results for every attempt separately (#25596)
## Description
- Upload results for every attempt separately
#### Type of change
- Workflow changes
#### How Has This Been Tested?
- Workflow run
2023-07-21 18:05:54 +05:30
Saroj
cf7883e398
ci: Fix comment issue in PR for failed specs (#25584)
## Description
- Fix comment issue in PR for failed specs

#### Type of change
- Workflow file changes
## Testing
>
#### How Has This Been Tested?
- Workflow run
2023-07-21 16:37:14 +05:30
Saroj
557fbff4cb
ci: Fix the failed spec artefact name (#25524)
## Description
- Fix the failed spec artefact name

#### Type of change
- Workflow changes
## Testing
>
#### How Has This Been Tested?
- Workflow run
2023-07-20 15:49:35 +05:30
Saroj
07dc6ee9ad
ci: Changes to enable rerun with custom script (#25480)
## Description
- Changes to enable rerun with custom script
#### Type of change
- Workflow file changes
## Testing
>
#### How Has This Been Tested?
 - Workflow run
## Checklist:
#### Dev activity
#### QA activity:
- [ ] [Speedbreak
features](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#speedbreakers-)
have been covered
- [ ] Test plan covers all impacted features and [areas of
interest](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#areas-of-interest-)
- [ ] Test plan has been peer reviewed by project stakeholders and other
QA members
- [ ] Manually tested functionality on DP
- [ ] We had an implementation alignment call with stakeholders post QA
Round 2
- [ ] Cypress test cases have been added and approved by SDET/manual QA
- [ ] Added `Test Plan Approved` label after Cypress tests were reviewed
- [ ] Added `Test Plan Approved` label after JUnit tests were reviewed
2023-07-19 17:02:24 +05:30
Saroj
f064d01f84
ci: Remove cypress env values for custom script run (#25475)
## Description
- Remove cypress env values for custom script run
#### PR fixes following issue(s)
Fixes # (issue number)
> if no issue exists, please create an issue and ask the maintainers
about this first
>
>
#### Media
> A video or a GIF is preferred. when using Loom, don’t embed because it
looks like it’s a GIF. instead, just link to the video
>
>
#### Type of change
> Please delete options that are not relevant.
- Bug fix (non-breaking change which fixes an issue)
- New feature (non-breaking change which adds functionality)
- Breaking change (fix or feature that would cause existing
functionality to not work as expected)
- Chore (housekeeping or task changes that don't impact user perception)
- This change requires a documentation update
>
>
>
## Testing
>
#### How Has This Been Tested?
> Please describe the tests that you ran to verify your changes. Also
list any relevant details for your test configuration.
> Delete anything that is not relevant
- [ ] Manual
- [ ] Jest
- [ ] Cypress
>
>
#### Test Plan
> Add Testsmith test cases links that relate to this PR
>
>
#### Issues raised during DP testing
> Link issues raised during DP testing for better visiblity and tracking
(copy link from comments dropped on this PR)
>
>
>
## Checklist:
#### Dev activity
- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my own code
- [ ] I have commented my code, particularly in hard-to-understand areas
- [ ] I have made corresponding changes to the documentation
- [ ] My changes generate no new warnings
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] PR is being merged under a feature flag


#### QA activity:
- [ ] [Speedbreak
features](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#speedbreakers-)
have been covered
- [ ] Test plan covers all impacted features and [areas of
interest](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#areas-of-interest-)
- [ ] Test plan has been peer reviewed by project stakeholders and other
QA members
- [ ] Manually tested functionality on DP
- [ ] We had an implementation alignment call with stakeholders post QA
Round 2
- [ ] Cypress test cases have been added and approved by SDET/manual QA
- [ ] Added `Test Plan Approved` label after Cypress tests were reviewed
- [ ] Added `Test Plan Approved` label after JUnit tests were reviewed

---------

Co-authored-by: Aishwarya UR <aishwarya@appsmith.com>
2023-07-19 13:28:22 +05:30
Saroj
81a114642f
ci: Split specs and run Cypress without Cypress Dashboard (#25347)
- Hackathon
2023-07-19 12:12:36 +05:30