Commit Graph

1685 Commits

Author SHA1 Message Date
Shrikant Sharat Kandula
be63e1b404 ci: Add BASE build argument to all workflows 2023-10-18 19:20:55 +05:30
Aishwarya-U-R
f0f8a58140
ci: Removal of env's from Setting Cypress step (#28192)
## Description
- This PR removes the env's from Setting up Cypress step

#### Type of change
- Yml update (non-breaking change which fixes an issue)

## Testing
>
#### How Has This Been Tested?
- [X] Cypress CI limited runs

## Checklist:
#### QA activity:
- [X] Added `Test Plan Approved` label after changes were reviewed
2023-10-18 18:31:35 +05:30
Shrikant Sharat Kandula
988f60e7ff
ci: Add BASE build argument for DP builds 2023-10-18 17:31:30 +05:30
Aishwarya UR
2fbe0574b9 undo typo syntax 2023-10-18 16:12:51 +05:30
Aishwarya UR
94a903b40c undo typo change 2023-10-18 16:12:06 +05:30
Aishwarya UR
23c5a976ea trial env's rmeoval from setting up Cypress step 2023-10-18 16:08:36 +05:30
Shrikant Sharat Kandula
deb55d8b21
ci: Create separate base image so daily CI can cache better and run faster (#28182)
The layers in the Dockerfile that depend on downloading large files from
external sources, doesn't have to run every day, or at every PR. We
tried using Docker's caching configuration, but it's not as reliable as
we'd have liked.

A separate base image lends us much more control over the how long we
cache the downloaded files and how often we redo this.

This PR only _adds_ the base image. It doesn't change anything in the
build of the existing Docker image. That'll happen once we have the base
images for `release` and `master` already present on DockerHub.
2023-10-18 14:17:38 +05:30
Aishwarya-U-R
885c951066
test: Cypress | CI Stabilize (#27818)
## Description
- This PR adds tests for validating the set properties for widget across
all objects
- Covers only some scenarios from [Test
#2409](https://github.com/appsmithorg/TestSmith/issues/2409)
- Adds the failure cypress dashboard link directly in case of CI run
failures
- Flaky fix - Sanity/Datasources/SMTPDatasource_spec.js
- Cypress.on - exception & fail handling updated
- InvokeDispatchOnStore() created for logout/login Internal server
errors - trial fix for RBACFunctionalTests/OthersTabPermission_spec.js
- EditAppFromAppHover() improved to take app name also - trial fix
PropertyPane_Connections_Error_spec.js
- Flaky fix - TableV2_Property_ToggleJs_With_Binding_spec.js
- Flaky fix - Radio2_spec.ts
- Flaky fix - API_TestExecuteWithDynamicBindingInUrl_spec.ts
- Flaky fix - Button_with_API_spec.js
- AssertTableInVirtuosoList() improved to handle the DS name not present
in EE scenario also
- Flaky fix - Button_with_API_spec.js
- Flaky fix - Table_Style_ToggleJS_spec.js
- Flaky fix - Tablev2_Style_ToggleJS_spec


#### Type of change
- Script update (non-breaking change which fixes an issue)

## Testing
#### How Has This Been Tested?
- [X] Cypress CI runs

## Checklist:
#### QA activity:
- [X] Added `Test Plan Approved` label after Cypress tests were reviewed
2023-10-17 20:26:24 +05:30
Nikhil Nandagopal
05e729902f Updated Label Config 2023-10-16 13:58:45 +05:30
Satish Gandham
4ee6d20020
ci: Add perf v2 job to perf test command (#28095)
Co-authored-by: Satish Gandham <hello@satishgandham.com>
2023-10-16 09:48:30 +05:30
Abhijeet
1cda053bf3
feat: Add signature verification for tenant feature flags (#28053)
## Description
PR to add the signature verification for tenant feature flags. With this
PR we will make sure feature flags those are getting reported from CS
can't be mocked.

#### PR fixes following issue(s)
Fixes https://github.com/appsmithorg/cloud-services/issues/1394

#### Type of change
- New feature (non-breaking change which adds functionality)

## Testing
#### How Has This Been Tested?
- [x] Manual
- [ ] JUnit
- [ ] Jest
- [ ] Cypress
>
>


## Checklist:
#### Dev activity
- [x] My code follows the style guidelines of this project
- [x] I have performed a self-review of my own code
- [x] I have commented my code, particularly in hard-to-understand areas
- [ ] I have made corresponding changes to the documentation
- [x] My changes generate no new warnings
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] PR is being merged under a feature flag


#### QA activity:
- [ ] [Speedbreak
features](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#speedbreakers-)
have been covered
- [ ] Test plan covers all impacted features and [areas of
interest](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#areas-of-interest-)
- [ ] Test plan has been peer reviewed by project stakeholders and other
QA members
- [ ] Manually tested functionality on DP
- [ ] We had an implementation alignment call with stakeholders post QA
Round 2
- [ ] Cypress test cases have been added and approved by SDET/manual QA
- [ ] Added `Test Plan Approved` label after Cypress tests were reviewed
- [ ] Added `Test Plan Approved` label after JUnit tests were reviewed
2023-10-14 15:14:17 +05:30
Satish Gandham
538e557160
ci: Run perf tests in parallel (#28050)
Co-authored-by: Satish Gandham <hello@satishgandham.com>
2023-10-13 16:25:47 +05:30
Saroj
48a3f15ab1
test: Bump cypress version to 13.3.1 (#27987)
## Description
 - Bumped cypress version
 - Updated workflow files to use latest cypress GitHub-action 

#### Type of change
- Workflow files
- Package.json
- yarn.lock
## Testing
>
#### How Has This Been Tested?
- [x] Cypress

---------

Co-authored-by: Aishwarya UR <aishwarya@appsmith.com>
2023-10-13 10:49:56 +05:30
Nikhil Nandagopal
345b2325db Updated Label Config 2023-10-13 10:31:07 +05:30
Nikhil Nandagopal
20ad74a9a2 Updated Label Config 2023-10-13 10:30:36 +05:30
Saroj
b865ea3a57
test: Map widget automation (#27901)
## Description
- Map widget automation

#### Type of change
- Added spec to verify the map widget with all the possible settings
- Updated the workflows to include map widget spec for hosted runs and
not run for normal runs
## Testing
>
#### How Has This Been Tested?
- [x] Cypress
>
>
## Checklist:
#### QA activity:
- [ ] [Speedbreak
features](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#speedbreakers-)
have been covered
- [ ] Test plan covers all impacted features and [areas of
interest](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#areas-of-interest-)
- [ ] Test plan has been peer reviewed by project stakeholders and other
QA members
- [ ] Manually tested functionality on DP
- [ ] We had an implementation alignment call with stakeholders post QA
Round 2
- [ ] Cypress test cases have been added and approved by SDET/manual QA
- [ ] Added `Test Plan Approved` label after Cypress tests were reviewed
- [ ] Added `Test Plan Approved` label after JUnit tests were reviewed

---------

Co-authored-by: Aishwarya UR <aishwarya@appsmith.com>
2023-10-11 13:04:06 +05:30
Satish Gandham
d8501f82ad
ci: Run perf infra v2 in /perf-test command (#27934)
Co-authored-by: Satish Gandham <hello@satishgandham.com>
2023-10-11 11:10:43 +05:30
albinAppsmith
65178eaf7e
feat: Added custom hex colors for testing workflow (#27568)
## Description

Added workflow to check if there is any custom colors or hex codes is
being used. This workflow will be checking for the anomalies in the
entire file that has been changed by the developer.

#### PR fixes following issue(s)
Fixes https://github.com/appsmithorg/appsmith/issues/27839

#### Type of change
- New feature (non-breaking change which adds functionality)

## Testing
>
#### How Has This Been Tested?
> Please describe the tests that you ran to verify your changes. Also
list any relevant details for your test configuration.
> Delete anything that is not relevant
- [ ] Manual
- [ ] JUnit
- [ ] Jest
- [ ] Cypress
>
>
#### Test Plan
> Add Testsmith test cases links that relate to this PR
>
>
#### Issues raised during DP testing
> Link issues raised during DP testing for better visiblity and tracking
(copy link from comments dropped on this PR)
>
>
>
## Checklist:
#### Dev activity
- [x] My code follows the style guidelines of this project
- [x] I have performed a self-review of my own code
- [ ] I have commented my code, particularly in hard-to-understand areas
- [ ] I have made corresponding changes to the documentation
- [x] My changes generate no new warnings
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] PR is being merged under a feature flag


#### QA activity:
- [ ] [Speedbreak
features](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#speedbreakers-)
have been covered
- [ ] Test plan covers all impacted features and [areas of
interest](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#areas-of-interest-)
- [ ] Test plan has been peer reviewed by project stakeholders and other
QA members
- [ ] Manually tested functionality on DP
- [ ] We had an implementation alignment call with stakeholders post QA
Round 2
- [ ] Cypress test cases have been added and approved by SDET/manual QA
- [ ] Added `Test Plan Approved` label after Cypress tests were reviewed
- [ ] Added `Test Plan Approved` label after JUnit tests were reviewed

---------

Co-authored-by: Saroj <saroj@appsmith.com>
2023-10-10 17:16:17 +05:30
Shrikant Sharat Kandula
517f7a8eba
ci: Fix caching for PR CI runs 2023-10-06 15:48:07 +05:30
akash-codemonk
3dc1241468
chore: get browser logs from failed cypress tests (#27724)
Fixes https://github.com/appsmithorg/appsmith/issues/26006

Get browser console logs for failed tests. This will help with easier
debugging of flaky tests.

Sample artifact for a test
https://github.com/appsmithorg/appsmith/suites/16856147292/artifacts/962768313
Latest test run of the change:
https://github.com/appsmithorg/appsmith/actions/runs/6405413689

Trimming down the files to a max of 10 files, since the artifact size
can go upto a GB when there are a 1000 or more tests failing.

---------

Co-authored-by: Aishwarya-U-R <91450662+Aishwarya-U-R@users.noreply.github.com>
Co-authored-by: Aishwarya UR <aishwarya@appsmith.com>
2023-10-05 14:42:30 +05:30
Shrikant Sharat Kandula
5db1516e8d
ci: Remove unused setup-depot step on RTS workflow 2023-10-05 11:52:03 +05:30
Saroj
20c5290c57
ci: Fix ci-test workflows (#27583)
## Description
- Fix ci-test workflows

#### Type of change
- Workflow files
## Testing
- CI run
2023-10-05 10:38:48 +05:30
Aishwarya-U-R
c3d546d434
test: Cypress | App level Import test (non-Gsheet) + CI Stabilize (#27683)
## Description
- This PR includes script for App level import for ds - MySql (non
Gsheet)
- Fixes flaky Replay_Editor_spec.js

#### Type of change
- Script update (non-breaking change which fixes an issue)

## Testing

#### How Has This Been Tested?
- [X] Cypress

## Checklist:
#### QA activity:
- [X] Added `Test Plan Approved` label after Cypress tests were reviewed
2023-09-28 17:45:21 +05:30
Saroj
6f7dd7254b
ci: Fix ci test limit pr comment (#27603)
## Description
- Fix ci test limit pr comment

#### Type of change
- Workflow changes
## Testing
>
#### How Has This Been Tested?
- Workflow run
2023-09-26 04:56:27 +00:00
Saroj
50dc649977
ci: Fix failed spec pr comment (#27587)
## Description
- Fix failed spec pr comment

#### Type of change
- Workflow changes
## Testing
- Workflow run
2023-09-25 13:30:11 +05:30
Saroj
9895ee217e
ci: Split spec improvements for cypress ci runs (#26774)
> Pull Request Template
>
> Use this template to quickly create a well written pull request.
Delete all quotes before creating the pull request.
>
## Description
> Add a TL;DR when description is extra long (helps content team)
>
> Please include a summary of the changes and which issue has been
fixed. Please also include relevant motivation
> and context. List any dependencies that are required for this change
>
> Links to Notion, Figma or any other documents that might be relevant
to the PR
>
>
#### PR fixes following issue(s)
Fixes # (issue number)
> if no issue exists, please create an issue and ask the maintainers
about this first
>
>
#### Media
> A video or a GIF is preferred. when using Loom, don’t embed because it
looks like it’s a GIF. instead, just link to the video
>
>
#### Type of change
> Please delete options that are not relevant.
- Bug fix (non-breaking change which fixes an issue)
- New feature (non-breaking change which adds functionality)
- Breaking change (fix or feature that would cause existing
functionality to not work as expected)
- Chore (housekeeping or task changes that don't impact user perception)
- This change requires a documentation update
>
>
>
## Testing
>
#### How Has This Been Tested?
> Please describe the tests that you ran to verify your changes. Also
list any relevant details for your test configuration.
> Delete anything that is not relevant
- [ ] Manual
- [ ] JUnit
- [ ] Jest
- [ ] Cypress
>
>
#### Test Plan
> Add Testsmith test cases links that relate to this PR
>
>
#### Issues raised during DP testing
> Link issues raised during DP testing for better visiblity and tracking
(copy link from comments dropped on this PR)
>
>
>
## Checklist:
#### Dev activity
- [ ] My code follows the style guidelines of this project
- [ ] I have performed a self-review of my own code
- [ ] I have commented my code, particularly in hard-to-understand areas
- [ ] I have made corresponding changes to the documentation
- [ ] My changes generate no new warnings
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] PR is being merged under a feature flag


#### QA activity:
- [ ] [Speedbreak
features](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#speedbreakers-)
have been covered
- [ ] Test plan covers all impacted features and [areas of
interest](https://github.com/appsmithorg/TestSmith/wiki/Guidelines-for-test-plans#areas-of-interest-)
- [ ] Test plan has been peer reviewed by project stakeholders and other
QA members
- [ ] Manually tested functionality on DP
- [ ] We had an implementation alignment call with stakeholders post QA
Round 2
- [ ] Cypress test cases have been added and approved by SDET/manual QA
- [ ] Added `Test Plan Approved` label after Cypress tests were reviewed
- [ ] Added `Test Plan Approved` label after JUnit tests were reviewed
2023-09-25 09:49:21 +05:30
Saroj
d6641877ad
test: Fix gsheet tests (#27389)
## Description
-  Fixing the browser issue for gsheet tests

#### Type of change
- Workflow file changes
- plugin/index.js changes
## Testing
>
#### How Has This Been Tested?
- [x] [Cypress
](https://github.com/appsmithorg/appsmith/actions/runs/6248887548)
2023-09-21 10:44:23 +05:30
Aishwarya-U-R
a8c50cfb37
test: Cypess | Oracle DS validations added (Part 5) + CI Stabilize (#27440)
## Description
- This PR adds below:
- Oracle - Delete table data validation
- Deploy App & verify the deleted data
- Bind query to already existing table widget, deploy, Filter table &
verify
- Improved AssertPopoverTooltip - to handle both tooltip elements
- Oracle - Copy, Move query validated [Tc #
2363](https://github.com/appsmithorg/TestSmith/issues/2363)
- Oracle - Query settings page validation covered [Tc #
2365](https://github.com/appsmithorg/TestSmith/issues/2365)
- Oracle - Widgets (Select, DatePicker) to Insert query binding [Tc #
2366](https://github.com/appsmithorg/TestSmith/issues/2366)
- Updated ToggleConfirmBeforeRunning() to run for Api & Queries
- Enabling limited-workflow re-run

#### Type of change
- Script fix (non-breaking change which fixes an issue)

## Testing
>
#### How Has This Been Tested?
- [X] Cypress CI runs

## Checklist:
#### QA activity:
- [X] Added `Test Plan Approved` label after Cypress tests were reviewed
2023-09-20 00:56:11 +05:30
Aishwarya-U-R
8c1db6576d
ci: Push workflow notification - Generate slack message fix (#27439)
## Description
- This PR updates the Generate slack message step to display PR title in
Slack notification for better readibility
2023-09-19 14:30:42 +05:30
Aishwarya-U-R
7279f9f09f
test: Cypess | Oracle DS validations added (Part 4) + CI Stabilize (#27348)
## Description
- This PR adds below:
- Oracle - Update query validation
- Deploy App & verify the updated data
- EmbedSettings/EmbedSettings_spec.js - trial fix
- Sanity/Datasources/SMTPDatasource_spec.js - toast message validation
fix
- Apps/CommunityIssues_Spec.ts - flaky fix
- Push workflow slack title update to PR title - trial
- Excluding `7. Verify Airtable documentation opens` for Airgap runs

#### Type of change
- Script fix (non-breaking change which fixes an issue)

## Testing
#### How Has This Been Tested?
- [X] Cypress CI runs

## Checklist:
#### QA activity:
- [X] Added `Test Plan Approved` label after Cypress tests were reviewed

---------

Co-authored-by: Ankita Kinger <ankita@appsmith.com>
2023-09-19 14:17:30 +05:30
Aishwarya UR
9b46e7e127 Slack push sucess icon 2023-09-16 13:02:37 +05:30
Aishwarya-U-R
74f67fbfdf
test: Cypess | Oracle DS validations added (Part 3) + CI Stabilize (#27326)
## Description
- This PR does below:
- Oracle - Create new table, insert data & select. tc #
[2358](https://github.com/appsmithorg/TestSmith/issues/2358) tc #
[2360](https://github.com/appsmithorg/TestSmith/issues/2358)
- Oracle - Alter the new table for 2 new columns, insert multiple rows
into table
- Oracle - Select * from table & select with condition tc #
[2359](https://github.com/appsmithorg/TestSmith/issues/2359)
- Oracle - Add table widget from Suggested widget section, Deploy the
app & verify table data load
- Oracle - Back to Editor, Delete all queries, Delete DS
- Failure fix - ClientSide/Git/GitSync/Connection_spec.js fo CI runs

#### Type of change
- Script fix + update (non-breaking change which fixes an issue)

## Testing
#### How Has This Been Tested?
- [X] Cypress CI runs

## Checklist:
#### QA activity:
- [X] Added `Test Plan Approved` label after Cypress tests were reviewed
2023-09-15 14:06:23 +05:30
Shrikant Sharat Kandula
30ed8fa276
ci: Fix syntax error 2023-09-15 12:56:39 +05:30
Aishwarya UR
6f815de9a0 Slack footer & icon update 2023-09-15 08:06:30 +05:30
Aishwarya-U-R
f11a343f29
ci: Cypress Push Slack notification fixes (#27325)
## Description
- This PR updates the slack emojies for Push workflow statuses
2023-09-14 21:52:03 +05:30
Aishwarya-U-R
366662499c
ci: Cypress Push Slack notification fixes (#27311)
## Description
- This PR does below:
- Reverting hosted run slack notif since no new_failed_spec is set (to
set & then fix this)
- Push notif slack msg trial fix

#### Type of change
- Script fix (non-breaking change which fixes an issue)

## Testing
>
#### How Has This Been Tested?
- [X] Cypress CI runs

## Checklist:
#### QA activity:
- [X] Added `Test Plan Approved` label after Cypress tests were reviewed
2023-09-14 20:42:49 +05:30
Nikhil Nandagopal
d23e24008d Updated Label Config 2023-09-14 18:51:46 +05:30
Aishwarya-U-R
6fcf9b48c4
test: Cypess | Oracle DS validations added (Part 2) + CI Stabilize (#27282)
## Description
- This PR adds Oracle validations
- 'Add more' validated from Oracle Ds page
- Tc's automated Tc
[#2204](https://github.com/appsmithorg/TestSmith/issues/2204)
- Added a bit of sleep for keyboard actions (Enter, Escape, Delete)
- Added default param for datasources._host
- Oracle documentation verification added
- get cypress url dashboard url - step commented in ymls, as its no more
used
- Updating Slack message to also display the failing specs in notif
- ElasticSearch spec - update to check hosted run
- ServerSide/GenerateCRUD/MySQL2_Spec.ts - EntityExplore ds name miss
fix
- Update waitForServerRestart() timeout

#### Type of change
- Script fix (non-breaking change which fixes an issue)

## Testing

#### How Has This Been Tested?
- [X] Cypress CI runs

## Checklist:
#### QA activity:
- [X] Added `Test Plan Approved` label after Cypress tests were reviewed
2023-09-14 16:53:42 +05:30
Abhijeet Mishra
29ad5725c4
feat: add template upload auth env var to server-build (#27252)
## Description
Add environment variable for community template upload for the
server-build workflow
2023-09-14 13:39:13 +05:30
Nikhil Nandagopal
efba60e2de Updated Label Config 2023-09-14 13:00:18 +05:30
Nikhil Nandagopal
5b8e681713 Updated Label Config 2023-09-14 12:44:29 +05:30
Nikhil Nandagopal
42c6d0032a Updated Label Config 2023-09-14 12:43:55 +05:30
Nikhil Nandagopal
3ab9d06ff9 Updated Label Config 2023-09-14 12:32:00 +05:30
Aishwarya-U-R
7985a551f6
test: Cypess | Oracle DS validations added (Part 1) + CI Stabilize (#27161)
## Description
- Adds validations for Oracle Ds to run in Hosted instance
- Trial fix for EmbedSettings/EmbedSettings_spec.js (checking the
Appsmith is starting page goes away on its own)
- Block_Execution.ts - updated to use Oracle mock data
- Oracle tests [TC
#2354](https://github.com/appsmithorg/TestSmith/issues/2354), [TC
#2355](https://github.com/appsmithorg/TestSmith/issues/2355), [TC
#2356](https://github.com/appsmithorg/TestSmith/issues/2356), [TC
#2357](https://github.com/appsmithorg/TestSmith/issues/2357) Automated
- Set Commit Message update for Hosted runs since now Airtable,
ElasticSearch are also part along with GSheet cases
- SMTP added verification on mail details (from, to, status, msg body
etc)
- Widgets/WidgetPropertySetters_spec.ts - Lint error case flaky fix

#### Type of change
- Script fix (non-breaking change which fixes an issue)

## Testing
>
#### How Has This Been Tested?
- [X] Cypress CI runs

## Checklist:
#### QA activity:
- [X] Added `Test Plan Approved` label after Cypress tests were reviewed
2023-09-13 22:33:14 +05:30
Aishwarya-U-R
2cd4555259
ci: Set Commit Message update (#27247)
## Description
- This PR fixes the PR runs where single quotes can be present in PR
desc

---------

Co-authored-by: Saroj <43822041+sarojsarab@users.noreply.github.com>
2023-09-13 13:25:52 +05:30
Aishwarya-U-R
cc00c77685
ci: Cypress Push Slack notification fixes (#27241)
## Description
- Since ci-hosted run has no build failures - that is removed
- For push flow, step id is added for correct status capture
2023-09-13 11:55:31 +05:30
Aishwarya-U-R
d50edbca7d
ci: Cypress Push Slack notification handling build failures (#27234)
## Description
- This PR updates the slack notification link from Cypress dashboard to
Build failures Git actions link incase of any build failure
2023-09-12 21:22:06 +05:30
Ankita Kinger
7bb99aff90
chore: Adding slack notification for promotion TBP workflow failure (#27213) 2023-09-12 19:58:31 +05:30
Nikhil Nandagopal
de6cce6443 Updated Label Config 2023-09-12 16:37:17 +05:30
Aishwarya-U-R
d463b0a7c1
ci: Cypress Push Slack notification update (#27190)
## Description
- This PR updates the slack notification for Push workflows for
debugging flaky tests(internal purpose)
2023-09-12 13:32:25 +05:30