Commit Graph

147 Commits

Author SHA1 Message Date
Rajat Agrawal
ba5affb3cd
chore: print workflow information (#24731)
This PR prints github event when ok-to-test command is run. This is
needed for debugging optimization changes to skip server tests if there
are no server side changes.
2023-06-22 12:10:10 +05:30
Rajat Agrawal
dd08e096c5
Revert "chore: Skip tests in server build if no changes in server files for ok-to-test command" (#24721)
Reverts appsmithorg/appsmith#24616
2023-06-22 09:07:28 +05:30
Rajat Agrawal
7ceaa9a0c9
chore: Skip tests in server build if no changes in server files for ok-to-test command (#24616)
Fixes #24700

These changes will allow the CI to skip tests if there are no changes in
server folder when using ok-to-test command. This will save CI minutes
2023-06-21 14:50:28 +05:30
Satish Gandham
5529a9a479
ci: Run perf infra v2 on CI (#24048)
Co-authored-by: Satish Gandham <hello@satishgandham.com>
2023-06-05 19:19:18 +05:30
Aishwarya-U-R
f88c1b1077
ci: Update the text in Git comment flaky tests app link (#22307)
## Description

- This PR updates the text message that gets commented after a PR run

## Type of change

- Yml file update

## Checklist:
### QA activity:
- [X] Added Test Plan Approved label after reviewing all changes
2023-04-12 11:07:55 +05:30
Aishwarya-U-R
5f1e4d1ba8
test: Cypress - flaky fix + Git comment improve (#22169)
## Description

- This fixes the Firestore spec that fails sometimes in CI due to all
runs accessing the same cloud collection for validation.
- This PR also adds comments to PR - if all cypress cases passed, right
now there is no comment

## Type of change

- Script update

## How Has This Been Tested?

- Cypress CI runs


## Checklist:
### QA activity:
- [X] Added Test Plan Approved label after reviewing all Cypress test
2023-04-10 17:41:14 +05:30
Saroj
292c32407b
ci: Added 'Workflow run' and 'Commit' for the failed spec comments (#22128)
## Description
- Added 'Workflow run' and 'Commit' for the failed spec comments

## Type of change
- YML Changes

## How Has This Been Tested?
- CI run

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test

---------

Co-authored-by: Aishwarya UR <aishwarya@appsmith.com>
2023-04-05 14:45:59 +05:30
Aishwarya-U-R
dffbf3d97c
ci: Adding Identified Flaky tests app link into Git comments section in a PR (#21966)
## Description

- This PR adds the Flaky list application link into the git comments
section on completion of the run, so the PR owners have easy access to
it.


## Type of change

- Yml file update

## Checklist:

### QA activity:
- [X] Added Test Plan Approved label after reviewing all changes
2023-03-31 16:55:51 +05:30
Saroj
a5aabe7bbc
ci: Upload an empty failed-spec-ci file if all the specs are passed (#21914)
## Description
-  Upload an empty failed-spec-ci file if all the specs are  passed

## Type of change
- YML file changes

## How Has This Been Tested?
- github actions

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-30 20:14:22 +05:30
Saroj
f3211dd2f5
ci: Added dub points for failed-spec comment (#21810)
## Description
- Added dub points for failed-spec comment

## Type of change
- YML File changes


## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-28 09:51:55 +05:30
Saroj
f17df15953
ci: Fix for combined-failed-spec-ci cache not found issue (#21706)
## Description
- Fix for combined-failed-spec-ci cache not found issue

## Type of change
- YML file changes

## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-23 10:51:41 +05:30
Saroj
bc79466a99
ci: Updated the workflow files to use actions/cache@v3 (#21669)
## Description
- Updated the workflow files to use actions/cache@v3 

## Type of change
- yml file changes

## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-22 16:17:13 +05:30
Saroj
a872435320
ci: Reverting the use of combined-failed-spec-ci artifact instead of cache (#21663)
## Description
- Reverting the use of combined-failed-spec-ci artifact instead of cache

## Type of change
- yml file changes

## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-22 09:44:41 +05:30
Saroj
c4897157dd
ci: Deleting the combined-failed-spec-ci in ci-test-result (#21661)
## Description
- Deleting the combined-failed-spec-ci in ci-test-result

## Type of change
- Yml file changes

## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-22 00:23:31 +05:30
Saroj
3d4e0bc99d
ci: Deleting the failed-spec-ci once it is downloaded in ci-test-result to avoid getting specs from older runs (#21646)
## Description
- Deleting the failed-spec-ci once it is downloaded in ci-test-result to
avoid getting specs from older runs

## Type of change
- yml file changes


## How Has This Been Tested?
- Manual


## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-21 21:23:10 +05:30
Saroj
d61fc746ac
ci: Removed the artifact deleting as we need the artifact in case of rerun on cancel (#21609)
## Description
- Removed the artifact deleting as we need the artifact in case of rerun
on cancel

## Type of change
- Workflow yml files

## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-21 08:27:11 +05:30
Saroj
b565f17ead
ci: Removing the old combined failed spec file (#21591)
## Description
- Removing the old combined failed spec file

## Type of change
- workflow files

## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-20 16:09:00 +05:30
Aishwarya-U-R
50bc2f6917
test: Cypress - Automated tests for Airtable datasource (#21550)
## Description

- This PR includes tests for Airtable ds - along with connection &
querying & usage of various fields in the query page

## Type of change

- New script (non-breaking change which test functionality of Airtable
data-source)

## How Has This Been Tested?
- Cypress CI runs

## Checklist:
### QA activity:
- [X] Added Test Plan Approved label after reviewing all changes
2023-03-19 01:12:01 +05:30
Aishwarya-U-R
04b794fddd
test: Cypress - Automated basic tests for MsSQL DS (#21446)
## Description

- This PR includes basic tests for connecting to a MsSQL ds & running
simple queries on it

## Type of change

- New script (non-breaking change which functional tests the MsSql ds)


## How Has This Been Tested?

- Cypress local & CI run


## Checklist:
### QA activity:
- [X] Added Test Plan Approved label after reviewing all Cypress test
2023-03-16 23:58:32 +05:30
Saroj
7437b89e1c
ci: Deleting duplicate specs while commenting in the pr (#21465)
## Description
- Deleting duplicate specs while commenting failed specs in the pr

## Type of change
- integration-tests-command.yml

## How Has This Been Tested?
- Manual

## Checklist
### QA activity:
- [X] Added Test Plan Approved label after reviewing all changes
2023-03-16 12:59:22 +05:30
Saroj
3614e56d52
ci: Fix for failed spec comment issue (#21399)
## Description
- Added step to delete the failed-spec-ci after combining all results to
address the issue

## Type of change
- ci

## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-14 17:49:19 +05:30
Saroj
9b59ff469e
ci: Added steps to use the pre built docker image instead of building a new one (#21318)
## Description
- Added steps to use the pre built docker image instead of building a
new one in perf-test.yml

## Type of change
- perf-test.yml

## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-10 16:26:20 +05:30
Saroj
4ad92d648a
ci: CI optimisation to reduce ci-test run time and modularise docker image building (#21219)
## Description
- Modularised the docker image building
- Optimised the `install dependancies` step to reduce the time from 8
mins to 30-40 secs now
- Removed unnecessary steps from the ci-dubugging.yml 
- Added ci-debug.sh file to ease the steps to run ngrok while running
ci-debugging
- Changes made to below files
1.  integration-tests-command.yml
2. test-build-docker-image.yml
3. ci-test.yml
4. build-docker-image.yml

## Type of change
- integration-tests-command.yml
- test-build-docker-image.yml
- ci-test.yml
- build-docker-image.yml

## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-10 12:51:32 +05:30
Shrikant Sharat Kandula
1cf9790a46
ci: Fix new failure list comment formatting 2023-02-25 09:10:45 +05:30
Aishwarya-U-R
ff28def4c8
Update integration-tests-command.yml 2023-02-24 14:24:28 +05:30
Aishwarya-U-R
df72ee8692
test: Workflow update to remove duplication of github comments for failing specs (#20689)
## Description

- This PR includes yml file update to remove the duplicate entry of
failing specs in github comments during PR oktotest runs

## Type of change

- Script fix

## Checklist:
### QA activity:
- [X] Added Test Plan Approved label after reviewing all changes
2023-02-24 14:07:33 +05:30
Saroj
eb9f5280e9
ci: Modularize ci-test (#20240)
## Description
- Modularising the ci-test

## Type of change
- Workflow files

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-02-02 16:56:29 +05:30
Aishwarya-U-R
7607883ab5
ci: Cypress CI run Group name update (#19119)
## Description

- This PR includes the script updates for connecting to TED Git instead
of actual Github for running tests

## Type of change

- New script changes to connect to TED Git

## How Has This Been Tested?
- Cypress CI runs

## Checklist:
### QA activity:
- [X] Test plan has been approved by relevant developers
- [X] Test plan has been peer reviewed by QA
- [X] Cypress test cases have been added and approved by either SDET or
manual QA
- [X] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [X] Added Test Plan Approved label after reveiwing all Cypress test
2023-01-27 09:42:15 +05:30
Aishwarya-U-R
c4d7462fb3
ci: Fat migration CI Re-run fix (#20040)
## Description

- This PR skips the upgrade spec until its fully functional

## Type of change

- Script fix

## Checklist:
### QA activity:
- [X] Cypress test cases have been added and approved by either SDET or
manual QA
2023-01-27 07:02:29 +05:30
Aishwarya-U-R
0b28b754b0
test: Moving specs to run on FatContainer + Gitea migration (#18920)
## Description

- This PR moves all specs from slim to fat container to run tests underneath it
- Fat has the actual libraries that are being shipping to customers, hence this PR
- Also includes moving Git tests from using GitHub to Gitea

## Type of change
- New run (non-breaking change which adds functionality)


## How Has This Been Tested?
- Cypress CI Fat runs

## Checklist:
### QA activity:
- [X] Test plan has been approved by relevant developers
- [X] Test plan has been peer reviewed by QA
- [X] Cypress test cases have been added and approved by either SDET or manual QA
- [X] Organized project review call with relevant stakeholders after Round 1/2 of QA
- [X] Added Test Plan Approved label after reveiwing all Cypress test

Co-authored-by: yatinappsmith <84702014+yatinappsmith@users.noreply.github.com>
2023-01-25 11:09:02 +05:30
Satish Gandham
03c2d61305
ci: Make perf tests a blocking check (#19977)
Makes perf tests a blocking check.

Co-authored-by: Satish Gandham <hello@satishgandham.com>
2023-01-23 11:22:16 +05:30
Hetu Nandu
c5388e465e
ci: Add spoiler to list failed ui tests (#19790)
## Description

Hides the list of failed tests behind a spoiler to avoid making PR pages
very long


Fixes # N/A


## Type of change

- Chore (housekeeping or task changes that don't impact user perception)
2023-01-16 09:46:32 +05:30
ChandanBalajiBP
9c30dadd31
ci: Add host gateway to connect cloud services (#19541)
Added host gateway to fix cloud services connectivity issue
2023-01-06 22:45:00 +05:30
Nidhi
bd96872fc6
chore: Added JDK setup to slim Cypress tests as well (#19433) 2023-01-02 19:15:14 +05:30
Nidhi
dfccd5a058
chore: Upgrade to Spring Boot 3.0.1 (#19044)
This upgrade takes care of our move to JDK 17, Spring Boot 3.0.1 and a
few other security upgrades along the way.

Fixes #18993 

TODO:

- [x] Check CI changes for Java 17
- [x] Check vulnerability report
- [x] Mongock needs an upgrade
- [x] Add JVM args at all possible places for exposing java.time module
- [x] Add type adapters everywhere / use the same config for type
adapters everywhere
2023-01-02 19:40:59 +07:00
Satish Gandham
d0044fedb9
ci: Add perf tests back (#19184)
This PR adds the perf tests back, but still not a blocking check.

Co-authored-by: Satish Gandham <hello@satishgandham.com>
2022-12-23 19:01:03 +05:30
Satish Gandham
5174ba8375
ci: Do not run perf tests as a part of ok-to-test and make it non blocking (#19140)
Remove perf-tests from /ok-to-test temporarily.

**Why**
Switch to github runners is causing an issue with perf tests, disabling until that is resolved.

Co-authored-by: Satish Gandham <hello@satishgandham.com>
2022-12-22 20:08:42 +05:30
yatinappsmith
bff3f326cd
ci: Fix run result due to deprecated command (#19084)
## Description

Ci fix run result due to deprecated 

Fixes # (issue)



Media



## Type of change



- Bug fix (non-breaking change which fixes an issue)



## How Has This Been Tested?
code reivew

### Test Plan


### Issues raised during DP testing



## Checklist:
### Dev activity
- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my own code
- [ ] I have commented my code, particularly in hard-to-understand areas
- [ ] I have made corresponding changes to the documentation
- [ ] My changes generate no new warnings
- [ ] I have added tests that prove my fix is effective or that my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] PR is being merged under a feature flag


### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or manual QA
- [ ] Organized project review call with relevant stakeholders after Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2022-12-21 15:31:55 +05:30
yatinappsmith
e50d309161
ci: fix PR number in adding failed tests (#19065) 2022-12-20 15:15:09 +05:30
yatinappsmith
876cd428f9
ci: Comment failing tests to PR (#18450)
## Description

Comment failing tests to PR

Fixes # 



## Type of change

- New feature (non-breaking change which adds functionality)


## How Has This Been Tested?
Code review. Tested in local fork

### Test Plan
> Add Testsmith test cases links that relate to this PR

### Issues raised during DP testing
> Link issues raised during DP testing for better visiblity and tracking (copy link from comments dropped on this PR)


## Checklist:
### Dev activity
- [X] My code follows the style guidelines of this project
- [X] I have performed a self-review of my own code
- [X] I have commented my code, particularly in hard-to-understand areas
- [X] I have made corresponding changes to the documentation
- [X] My changes generate no new warnings
- [X] I have added tests that prove my fix is effective or that my feature works
- [X] New and existing unit tests pass locally with my changes
- [X] PR is being merged under a feature flag


### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or manual QA
- [ ] Organized project review call with relevant stakeholders after Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2022-12-19 16:23:39 +05:30
Hetu Nandu
c5c8734dc1
chore: Update github actions to remove deprecation warnings (#18619) 2022-12-19 13:04:43 +05:30
Satish Gandham
519dd3a7a3
ci: Make perf tests a blocking check (#18955)
Make perf tests a blocking check

Co-authored-by: Satish Gandham <hello@satishgandham.com>
2022-12-14 18:39:53 +05:30
Parthvi
db19455e57
ci: Add three more runners for the fat container tests (#18915) 2022-12-13 14:36:33 +05:30
Anagh Hegde
77a225f4dd
ci: revert Add replicate set to the mongodb url for transaction PR (#18890)
Revert "ci: Add replicate set to the mongodb url for transaction PR (#18873)"

This reverts commit bc8022caf2.
2022-12-12 18:57:20 +05:30
Anagh Hegde
bc8022caf2
ci: Add replicate set to the mongodb url for transaction PR (#18873) 2022-12-12 16:28:00 +05:30
Satish Gandham
03703ff044
ci: Ship source maps + fix perf test failures on EE (#18700)
* - Add missing env variables to fix perf tests failures in EE

* - Delete source maps on CI only for EE

* - Add the additional steps that might be required for running perf tests on EE

* Update if condition

* Update if condition

* Switch to bash from using sh in build.sh

* Check if the server started later

* Update the check to see if the server has started

Co-authored-by: Satish Gandham <hello@satishgandham.com>
2022-12-09 18:40:59 +05:30
Parthvi
bc7659d53a
test: Add dummy users in Cypress test suite (#18675) 2022-12-06 11:21:54 +05:30
Rhitottam
4231a905c0
ci: Update perf infra dashboard link inside github workflows yml (#18702) 2022-12-06 10:17:27 +05:30
Trisha Anand
a7f1f365af
Revert "ci:update env variable" (#18607)
Revert "ci:update env variable (#18557)"

This reverts commit e0fe306503.
2022-12-01 16:08:02 +05:30
Parthvi
e0fe306503
ci:update env variable (#18557)
Co-authored-by: Shrikant Sharat Kandula <shrikant@appsmith.com>
2022-12-01 13:47:11 +05:30