Commit Graph

158 Commits

Author SHA1 Message Date
Nidhi
a3efa3cffd
ci: Moved QC around, removed unit tests running with ok to test (#25667) 2023-07-25 14:56:58 +05:30
Saroj
370748a2e5
ci: Fix to use cypress dashboard for ci test (#25618)
## Description
- Fix to use cypress dashboard for ci test

#### Type of change
- Workflow file changes
## Testing
>
#### How Has This Been Tested?
- workflow run
2023-07-24 10:56:01 +05:30
Saroj
cf7883e398
ci: Fix comment issue in PR for failed specs (#25584)
## Description
- Fix comment issue in PR for failed specs

#### Type of change
- Workflow file changes
## Testing
>
#### How Has This Been Tested?
- Workflow run
2023-07-21 16:37:14 +05:30
Satish Gandham
ab60be793d
ci: Disable perf-tests-v2 (#25317)
Disable perf-tests-v2.

Co-authored-by: Satish Gandham <hello@satishgandham.com>
2023-07-19 17:56:37 +05:30
Saroj
81a114642f
ci: Split specs and run Cypress without Cypress Dashboard (#25347)
- Hackathon
2023-07-19 12:12:36 +05:30
Rajat Agrawal
058c0261e2
chore: Fix changeset workflow to run on external contributor PR (#25227)
Fixes #25260
2023-07-12 10:40:19 +05:30
Saroj
9edd00050d
ci: Fix cypress dashboard link in pr comment (#24904)
## Description
- Fix cypress dashboard link in pr comment

#### Type of change
- Workflow file changes
## Testing
>
#### How Has This Been Tested?
- Workflow run
2023-06-28 15:56:32 +05:30
Saroj
a781a6d150
ci: Fix extracting the cypress dashboard url in ci-test-result (#24890)
## Description
- Fix extracting the cypress dashboard url in ci-test-result 
#### Type of change
- Workflow file changes
## Testing
>
#### How Has This Been Tested?
- Workflow file changes
2023-06-28 11:19:19 +05:30
Saroj
45ae5a2995
ci: Get the newly added files from the PR branch for ts check (#24825)
## Description
- Get the newly added files from the PR branch instead of commits for ts
check
- CI improvements, now added cypress dashboard link with the comments in
PR
- CI improvements removed the steps which saves un-necessary cache

#### Type of change
- Workflow file changes
## Testing
>
#### How Has This Been Tested?
- Workflow run
2023-06-27 22:25:44 +05:30
Saroj
e43f540770
ci: Skipping the ts file checks if not required (#24761)
## Description
- Skipping the ts check for test files if not required, introduced a
input variable for the client build to control this
#### Type of change
- Workflow file
## Testing
>
#### How Has This Been Tested?
- Workflow run
2023-06-22 21:33:58 +05:30
Rajat Agrawal
97f8facdd1
chore : Fix/skip test optimization (#24718)
This PR fixes incorrect diff calculation between base and head of the
pull request raised. This diff is used for determining if server tests
should run or not.

Related PR to this is :
https://github.com/appsmithorg/appsmith/pull/24731
2023-06-22 15:14:23 +05:30
Rajat Agrawal
ba5affb3cd
chore: print workflow information (#24731)
This PR prints github event when ok-to-test command is run. This is
needed for debugging optimization changes to skip server tests if there
are no server side changes.
2023-06-22 12:10:10 +05:30
Rajat Agrawal
dd08e096c5
Revert "chore: Skip tests in server build if no changes in server files for ok-to-test command" (#24721)
Reverts appsmithorg/appsmith#24616
2023-06-22 09:07:28 +05:30
Rajat Agrawal
7ceaa9a0c9
chore: Skip tests in server build if no changes in server files for ok-to-test command (#24616)
Fixes #24700

These changes will allow the CI to skip tests if there are no changes in
server folder when using ok-to-test command. This will save CI minutes
2023-06-21 14:50:28 +05:30
Satish Gandham
5529a9a479
ci: Run perf infra v2 on CI (#24048)
Co-authored-by: Satish Gandham <hello@satishgandham.com>
2023-06-05 19:19:18 +05:30
Aishwarya-U-R
f88c1b1077
ci: Update the text in Git comment flaky tests app link (#22307)
## Description

- This PR updates the text message that gets commented after a PR run

## Type of change

- Yml file update

## Checklist:
### QA activity:
- [X] Added Test Plan Approved label after reviewing all changes
2023-04-12 11:07:55 +05:30
Aishwarya-U-R
5f1e4d1ba8
test: Cypress - flaky fix + Git comment improve (#22169)
## Description

- This fixes the Firestore spec that fails sometimes in CI due to all
runs accessing the same cloud collection for validation.
- This PR also adds comments to PR - if all cypress cases passed, right
now there is no comment

## Type of change

- Script update

## How Has This Been Tested?

- Cypress CI runs


## Checklist:
### QA activity:
- [X] Added Test Plan Approved label after reviewing all Cypress test
2023-04-10 17:41:14 +05:30
Saroj
292c32407b
ci: Added 'Workflow run' and 'Commit' for the failed spec comments (#22128)
## Description
- Added 'Workflow run' and 'Commit' for the failed spec comments

## Type of change
- YML Changes

## How Has This Been Tested?
- CI run

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test

---------

Co-authored-by: Aishwarya UR <aishwarya@appsmith.com>
2023-04-05 14:45:59 +05:30
Aishwarya-U-R
dffbf3d97c
ci: Adding Identified Flaky tests app link into Git comments section in a PR (#21966)
## Description

- This PR adds the Flaky list application link into the git comments
section on completion of the run, so the PR owners have easy access to
it.


## Type of change

- Yml file update

## Checklist:

### QA activity:
- [X] Added Test Plan Approved label after reviewing all changes
2023-03-31 16:55:51 +05:30
Saroj
a5aabe7bbc
ci: Upload an empty failed-spec-ci file if all the specs are passed (#21914)
## Description
-  Upload an empty failed-spec-ci file if all the specs are  passed

## Type of change
- YML file changes

## How Has This Been Tested?
- github actions

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-30 20:14:22 +05:30
Saroj
f3211dd2f5
ci: Added dub points for failed-spec comment (#21810)
## Description
- Added dub points for failed-spec comment

## Type of change
- YML File changes


## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-28 09:51:55 +05:30
Saroj
f17df15953
ci: Fix for combined-failed-spec-ci cache not found issue (#21706)
## Description
- Fix for combined-failed-spec-ci cache not found issue

## Type of change
- YML file changes

## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-23 10:51:41 +05:30
Saroj
bc79466a99
ci: Updated the workflow files to use actions/cache@v3 (#21669)
## Description
- Updated the workflow files to use actions/cache@v3 

## Type of change
- yml file changes

## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-22 16:17:13 +05:30
Saroj
a872435320
ci: Reverting the use of combined-failed-spec-ci artifact instead of cache (#21663)
## Description
- Reverting the use of combined-failed-spec-ci artifact instead of cache

## Type of change
- yml file changes

## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-22 09:44:41 +05:30
Saroj
c4897157dd
ci: Deleting the combined-failed-spec-ci in ci-test-result (#21661)
## Description
- Deleting the combined-failed-spec-ci in ci-test-result

## Type of change
- Yml file changes

## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-22 00:23:31 +05:30
Saroj
3d4e0bc99d
ci: Deleting the failed-spec-ci once it is downloaded in ci-test-result to avoid getting specs from older runs (#21646)
## Description
- Deleting the failed-spec-ci once it is downloaded in ci-test-result to
avoid getting specs from older runs

## Type of change
- yml file changes


## How Has This Been Tested?
- Manual


## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-21 21:23:10 +05:30
Saroj
d61fc746ac
ci: Removed the artifact deleting as we need the artifact in case of rerun on cancel (#21609)
## Description
- Removed the artifact deleting as we need the artifact in case of rerun
on cancel

## Type of change
- Workflow yml files

## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-21 08:27:11 +05:30
Saroj
b565f17ead
ci: Removing the old combined failed spec file (#21591)
## Description
- Removing the old combined failed spec file

## Type of change
- workflow files

## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-20 16:09:00 +05:30
Aishwarya-U-R
50bc2f6917
test: Cypress - Automated tests for Airtable datasource (#21550)
## Description

- This PR includes tests for Airtable ds - along with connection &
querying & usage of various fields in the query page

## Type of change

- New script (non-breaking change which test functionality of Airtable
data-source)

## How Has This Been Tested?
- Cypress CI runs

## Checklist:
### QA activity:
- [X] Added Test Plan Approved label after reviewing all changes
2023-03-19 01:12:01 +05:30
Aishwarya-U-R
04b794fddd
test: Cypress - Automated basic tests for MsSQL DS (#21446)
## Description

- This PR includes basic tests for connecting to a MsSQL ds & running
simple queries on it

## Type of change

- New script (non-breaking change which functional tests the MsSql ds)


## How Has This Been Tested?

- Cypress local & CI run


## Checklist:
### QA activity:
- [X] Added Test Plan Approved label after reviewing all Cypress test
2023-03-16 23:58:32 +05:30
Saroj
7437b89e1c
ci: Deleting duplicate specs while commenting in the pr (#21465)
## Description
- Deleting duplicate specs while commenting failed specs in the pr

## Type of change
- integration-tests-command.yml

## How Has This Been Tested?
- Manual

## Checklist
### QA activity:
- [X] Added Test Plan Approved label after reviewing all changes
2023-03-16 12:59:22 +05:30
Saroj
3614e56d52
ci: Fix for failed spec comment issue (#21399)
## Description
- Added step to delete the failed-spec-ci after combining all results to
address the issue

## Type of change
- ci

## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-14 17:49:19 +05:30
Saroj
9b59ff469e
ci: Added steps to use the pre built docker image instead of building a new one (#21318)
## Description
- Added steps to use the pre built docker image instead of building a
new one in perf-test.yml

## Type of change
- perf-test.yml

## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-10 16:26:20 +05:30
Saroj
4ad92d648a
ci: CI optimisation to reduce ci-test run time and modularise docker image building (#21219)
## Description
- Modularised the docker image building
- Optimised the `install dependancies` step to reduce the time from 8
mins to 30-40 secs now
- Removed unnecessary steps from the ci-dubugging.yml 
- Added ci-debug.sh file to ease the steps to run ngrok while running
ci-debugging
- Changes made to below files
1.  integration-tests-command.yml
2. test-build-docker-image.yml
3. ci-test.yml
4. build-docker-image.yml

## Type of change
- integration-tests-command.yml
- test-build-docker-image.yml
- ci-test.yml
- build-docker-image.yml

## How Has This Been Tested?
- Manual

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-03-10 12:51:32 +05:30
Shrikant Sharat Kandula
1cf9790a46
ci: Fix new failure list comment formatting 2023-02-25 09:10:45 +05:30
Aishwarya-U-R
ff28def4c8
Update integration-tests-command.yml 2023-02-24 14:24:28 +05:30
Aishwarya-U-R
df72ee8692
test: Workflow update to remove duplication of github comments for failing specs (#20689)
## Description

- This PR includes yml file update to remove the duplicate entry of
failing specs in github comments during PR oktotest runs

## Type of change

- Script fix

## Checklist:
### QA activity:
- [X] Added Test Plan Approved label after reviewing all changes
2023-02-24 14:07:33 +05:30
Saroj
eb9f5280e9
ci: Modularize ci-test (#20240)
## Description
- Modularising the ci-test

## Type of change
- Workflow files

## Checklist:
### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or
manual QA
- [ ] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2023-02-02 16:56:29 +05:30
Aishwarya-U-R
7607883ab5
ci: Cypress CI run Group name update (#19119)
## Description

- This PR includes the script updates for connecting to TED Git instead
of actual Github for running tests

## Type of change

- New script changes to connect to TED Git

## How Has This Been Tested?
- Cypress CI runs

## Checklist:
### QA activity:
- [X] Test plan has been approved by relevant developers
- [X] Test plan has been peer reviewed by QA
- [X] Cypress test cases have been added and approved by either SDET or
manual QA
- [X] Organized project review call with relevant stakeholders after
Round 1/2 of QA
- [X] Added Test Plan Approved label after reveiwing all Cypress test
2023-01-27 09:42:15 +05:30
Aishwarya-U-R
c4d7462fb3
ci: Fat migration CI Re-run fix (#20040)
## Description

- This PR skips the upgrade spec until its fully functional

## Type of change

- Script fix

## Checklist:
### QA activity:
- [X] Cypress test cases have been added and approved by either SDET or
manual QA
2023-01-27 07:02:29 +05:30
Aishwarya-U-R
0b28b754b0
test: Moving specs to run on FatContainer + Gitea migration (#18920)
## Description

- This PR moves all specs from slim to fat container to run tests underneath it
- Fat has the actual libraries that are being shipping to customers, hence this PR
- Also includes moving Git tests from using GitHub to Gitea

## Type of change
- New run (non-breaking change which adds functionality)


## How Has This Been Tested?
- Cypress CI Fat runs

## Checklist:
### QA activity:
- [X] Test plan has been approved by relevant developers
- [X] Test plan has been peer reviewed by QA
- [X] Cypress test cases have been added and approved by either SDET or manual QA
- [X] Organized project review call with relevant stakeholders after Round 1/2 of QA
- [X] Added Test Plan Approved label after reveiwing all Cypress test

Co-authored-by: yatinappsmith <84702014+yatinappsmith@users.noreply.github.com>
2023-01-25 11:09:02 +05:30
Satish Gandham
03c2d61305
ci: Make perf tests a blocking check (#19977)
Makes perf tests a blocking check.

Co-authored-by: Satish Gandham <hello@satishgandham.com>
2023-01-23 11:22:16 +05:30
Hetu Nandu
c5388e465e
ci: Add spoiler to list failed ui tests (#19790)
## Description

Hides the list of failed tests behind a spoiler to avoid making PR pages
very long


Fixes # N/A


## Type of change

- Chore (housekeeping or task changes that don't impact user perception)
2023-01-16 09:46:32 +05:30
ChandanBalajiBP
9c30dadd31
ci: Add host gateway to connect cloud services (#19541)
Added host gateway to fix cloud services connectivity issue
2023-01-06 22:45:00 +05:30
Nidhi
bd96872fc6
chore: Added JDK setup to slim Cypress tests as well (#19433) 2023-01-02 19:15:14 +05:30
Nidhi
dfccd5a058
chore: Upgrade to Spring Boot 3.0.1 (#19044)
This upgrade takes care of our move to JDK 17, Spring Boot 3.0.1 and a
few other security upgrades along the way.

Fixes #18993 

TODO:

- [x] Check CI changes for Java 17
- [x] Check vulnerability report
- [x] Mongock needs an upgrade
- [x] Add JVM args at all possible places for exposing java.time module
- [x] Add type adapters everywhere / use the same config for type
adapters everywhere
2023-01-02 19:40:59 +07:00
Satish Gandham
d0044fedb9
ci: Add perf tests back (#19184)
This PR adds the perf tests back, but still not a blocking check.

Co-authored-by: Satish Gandham <hello@satishgandham.com>
2022-12-23 19:01:03 +05:30
Satish Gandham
5174ba8375
ci: Do not run perf tests as a part of ok-to-test and make it non blocking (#19140)
Remove perf-tests from /ok-to-test temporarily.

**Why**
Switch to github runners is causing an issue with perf tests, disabling until that is resolved.

Co-authored-by: Satish Gandham <hello@satishgandham.com>
2022-12-22 20:08:42 +05:30
yatinappsmith
bff3f326cd
ci: Fix run result due to deprecated command (#19084)
## Description

Ci fix run result due to deprecated 

Fixes # (issue)



Media



## Type of change



- Bug fix (non-breaking change which fixes an issue)



## How Has This Been Tested?
code reivew

### Test Plan


### Issues raised during DP testing



## Checklist:
### Dev activity
- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my own code
- [ ] I have commented my code, particularly in hard-to-understand areas
- [ ] I have made corresponding changes to the documentation
- [ ] My changes generate no new warnings
- [ ] I have added tests that prove my fix is effective or that my feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] PR is being merged under a feature flag


### QA activity:
- [ ] Test plan has been approved by relevant developers
- [ ] Test plan has been peer reviewed by QA
- [ ] Cypress test cases have been added and approved by either SDET or manual QA
- [ ] Organized project review call with relevant stakeholders after Round 1/2 of QA
- [ ] Added Test Plan Approved label after reveiwing all Cypress test
2022-12-21 15:31:55 +05:30
yatinappsmith
e50d309161
ci: fix PR number in adding failed tests (#19065) 2022-12-20 15:15:09 +05:30