Commit Graph

62 Commits

Author SHA1 Message Date
Abhijeet
1210104575
chore: Add mover script for Mongo to postgres migration (#36458)
## Description
PR to add:
1. Mover script : move-to-postgres.sh
2. Baseline data generation: regen-baseline.sh

/test Sanity

### 🔍 Cypress test results
<!-- This is an auto-generated comment: Cypress test results  -->
> [!TIP]
> 🟢 🟢 🟢 All cypress tests have passed! 🎉 🎉 🎉
> Workflow run:
<https://github.com/appsmithorg/appsmith/actions/runs/11027514472>
> Commit: c565b7a4d832b0d0e75df2f3122a1c0679235e88
> <a
href="https://internal.appsmith.com/app/cypress-dashboard/rundetails-65890b3c81d7400d08fa9ee5?branch=master&workflowId=11027514472&attempt=1"
target="_blank">Cypress dashboard</a>.
> Tags: `@tag.Sanity`
> Spec:
> <hr>Wed, 25 Sep 2024 06:54:08 UTC
<!-- end of auto-generated comment: Cypress test results  -->


## Communication
Should the DevRel and Marketing teams inform users about this change?
- [ ] Yes
- [x] No


<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **New Features**
- Introduced a new configuration file for instance management and
permission groups.
	- Added a custom JavaScript library for XML parsing.
- Implemented multiple database and API plugins, enhancing integration
capabilities.
- Established a tenant configuration for managing tenant-specific
settings.
	- Added an anonymous user entity for improved user management.

- **Bug Fixes**
	- Improved data migration script from MongoDB to Postgres.

- **Documentation**
	- Updated scripts for baseline data generation and migration processes.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-09-25 15:22:02 +05:30
Abhijeet
6ca9ef549e
feat: Make images adaptable to support both Postgres and MongoDB uris (#36424)
## Description
PR to make the release tag adaptable to work with both MongoDB and
PostgreSQL uris.

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit

- **New Features**
- Introduced a new script to automate the preparation of server
artifacts, improving the build process.
- Added SQL files to the indentation configuration for consistent code
formatting.

- **Improvements**
- Enhanced error handling in the Docker build process to ensure
essential files are present before execution.
- Updated service configuration logic to prevent misconfiguration based
on the environment.
- Added a new job step in the build workflow to prepare server artifacts
after the build process.
- Implemented conditional logic in the run script to dynamically adapt
to different database configurations.

- **Bug Fixes**
- Adjusted the initialization process to focus on MongoDB, improving
reliability in various environments.
<!-- end of auto-generated comment: release notes by coderabbit.ai -->

/test Sanity

### 🔍 Cypress test results
<!-- This is an auto-generated comment: Cypress test results  -->
> [!TIP]
> 🟢 🟢 🟢 All cypress tests have passed! 🎉 🎉 🎉
> Workflow run:
<https://github.com/appsmithorg/appsmith/actions/runs/10940528231>
> Commit: 32731e8a93a25e5c9456eb89daca2d8bf327c012
> <a
href="https://internal.appsmith.com/app/cypress-dashboard/rundetails-65890b3c81d7400d08fa9ee5?branch=master&workflowId=10940528231&attempt=1"
target="_blank">Cypress dashboard</a>.
> Tags: `@tag.Sanity`
> Spec:
> <hr>Thu, 19 Sep 2024 12:21:54 UTC
<!-- end of auto-generated comment: Cypress test results  -->


## Communication
Should the DevRel and Marketing teams inform users about this change?
- [ ] Yes
- [x] No
2024-09-19 21:45:46 +05:30
Goutham Pratapa
074233a6fd
fix failing dps (#34625)
## Description
> [!TIP]  
> _Add a TL;DR when the description is longer than 500 words or
extremely technical (helps the content, marketing, and DevRel team)._
>
> _Please also include relevant motivation and context. List any
dependencies that are required for this change. Add links to Notion,
Figma or any other documents that might be relevant to the PR._


Fixes #`Issue Number`  
_or_  
Fixes `Issue URL`
> [!WARNING]  
> _If no issue exists, please create an issue first, and check with the
maintainers if the issue is valid._

## Automation

/ok-to-test tags=""

### 🔍 Cypress test results
<!-- This is an auto-generated comment: Cypress test results  -->
> [!CAUTION]  
> If you modify the content in this section, you are likely to disrupt
the CI result for your PR.

<!-- end of auto-generated comment: Cypress test results  -->


## Communication
Should the DevRel and Marketing teams inform users about this change?
- [ ] Yes
- [ ] No
2024-07-02 12:36:40 +05:30
Shrikant Sharat Kandula
50150f79e2
ci: Use the newer DB URL 2024-07-01 21:36:43 +05:30
Shrikant Sharat Kandula
dc99eb1ac4
ci: Use latest version of helm chart for DPs (#34608)
If we don't specify a version with `--version`, the `help upgrade`
command takes the latest version. [Ref
documentation](https://helm.sh/docs/helm/helm_upgrade/).



![shot-2024-07-01-09-51-35](https://github.com/appsmithorg/appsmith/assets/120119/4d916c41-5b47-495a-bf06-cdd4d5205484)
2024-07-01 15:26:02 +05:30
Shrikant Sharat Kandula
ff44b4f60f
chore: Fix quoting in deploy_preview.sh (#34592)
**/test sanity**



<!-- This is an auto-generated comment: Cypress test results  -->
> [!TIP]
> 🟢 🟢 🟢 All cypress tests have passed! 🎉 🎉 🎉
> Workflow run:
<https://github.com/appsmithorg/appsmith/actions/runs/9716093497>
> Commit: f2381c9e21f3a2ab89a0de63375bbe58dc1fe726
> <a
href="https://internal.appsmith.com/app/cypress-dashboard/rundetails-65890b3c81d7400d08fa9ee5?branch=master&workflowId=9716093497&attempt=1"
target="_blank">Cypress dashboard</a>.
> Tags: `@tag.Sanity`

<!-- end of auto-generated comment: Cypress test results  -->



<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Chores**
- Updated deployment script to improve environment variable handling and
AWS configuration for preview environments.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-07-01 15:06:56 +05:30
Goutham Pratapa
230c225d7e
fix: failing dp builder (#34247)
## Description
> [!TIP]  
> _Add a TL;DR when the description is longer than 500 words or
extremely technical (helps the content, marketing, and DevRel team)._
>
> _Please also include relevant motivation and context. List any
dependencies that are required for this change. Add links to Notion,
Figma or any other documents that might be relevant to the PR._


Fixes #`Issue Number`  
_or_  
Fixes `Issue URL`
> [!WARNING]  
> _If no issue exists, please create an issue first, and check with the
maintainers if the issue is valid._

## Automation

/ok-to-test tags=""

### 🔍 Cypress test results
<!-- This is an auto-generated comment: Cypress test results  -->
> [!CAUTION]  
> If you modify the content in this section, you are likely to disrupt
the CI result for your PR.

<!-- end of auto-generated comment: Cypress test results  -->


## Communication
Should the DevRel and Marketing teams inform users about this change?
- [ ] Yes
- [ ] No
2024-06-14 13:00:54 +05:30
Goutham Pratapa
d53fdc7801
fix: update dp builder (#34203)
<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Chores**
- Updated deployment script to use the latest Helm chart version
(3.1.1).
- Changed database URI environment variable for better clarity and
consistency.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-06-13 16:07:07 +05:30
Shrikant Sharat Kandula
05690f8339
chore: Fail early when build of one component fails (#33958)
Fail early when build of one of the components fails, instead of
proceeding to build the Docker image and failing _much_ later.

[Slack
conversation](https://theappsmith.slack.com/archives/C02MUD8DNUR/p1717484636886919).

<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->

## Summary by CodeRabbit

- **Chores**
- Improved the build process with better error handling for server,
client, and RTS components, ensuring clearer messaging in case of build
failures.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-06-04 16:33:40 +05:30
Shrikant Sharat Kandula
e5455e0f90
chore: increment minor number for snapshot versions (#30487)
We've always wanted to increment minor versions instead of patch
versions for new releases, as it's more semantic. This PR will change
the snapshot version calculation to increment the minor number instead
of the patch number.

Came up from [this Slack
thread](https://theappsmith.slack.com/archives/CGBPVEJ5C/p1705674928122129?thread_ts=1704793408.986219&cid=CGBPVEJ5C).
2024-01-22 10:02:57 +05:30
Shrikant Sharat Kandula
ecf047a32d
fix: Fix version name's v prefix in info.json (#29508)
Fixes #29506.
2023-12-11 14:55:53 +05:30
Shrikant Sharat Kandula
5d8e565e59
chore: Fix version calculation incompatibility with mawk 2023-11-27 12:12:03 +05:30
Goutham Pratapa
8ed80df3eb
Update deploy_preview.sh (#28872) 2023-11-15 14:41:07 +05:30
Shrikant Sharat Kandula
8d34a2ac28 chore: Add BASE build arg to local_testing.sh 2023-10-18 19:37:42 +05:30
Goutham Pratapa
2e74e5a78b
adjust resource limits for dps (#27434) 2023-09-20 13:38:09 +05:30
Goutham Pratapa
e3c04ccbeb
install helm plugin to map deprecated K8s APIs (#27423) 2023-09-19 11:57:44 +05:30
Goutham Pratapa
b7a7b15173
add helm plugin to fix deprecated apis (#27419) 2023-09-19 10:46:11 +05:30
Goutham Pratapa
3a69f8e77c
bump helm chart version (#27196)
Depends: [2304](https://github.com/appsmithorg/appsmith-ee/pull/2304)
2023-09-18 14:43:48 +05:30
Shrikant Sharat Kandula
e78aa1193e
chore: Include version in info.json and remove fields that aren't being useful (#27288) 2023-09-15 15:50:23 +05:30
Goutham Pratapa
827e3738fe
Delete scripts/efs_guardian_job.json (#27160) 2023-09-11 16:44:10 +05:30
Goutham Pratapa
e83a73a363
fix cleanup of dps (#27159) 2023-09-11 16:37:27 +05:30
Goutham Pratapa
6250411d1e
update scripts to deploy dps with EFS (#26993)
Fixes: [322](https://github.com/appsmithorg/cloud-deployment/issues/322)
2023-09-11 16:24:17 +05:30
Shrikant Sharat Kandula
c594699eac
chore: Use single COPY command in Dockerfile for constant/static files (#27127)
Move the files that are copied into the Docker image, into an `fs`
folder, that reflects the folder structure of that in the image. This
means two things right away:

1. A single `COPY` instruction in `Dockerfile` is enough to copy all the
files to their places.
2. The structure of files in the repo reflects that in the Docker image.
This makes working with the files/folders and troubleshooting with them
much easier.

 Note: **There's actually only 3 files changed, rest are just moved.**
2023-09-11 08:43:09 +05:30
Sumesh Pradhan
1f5223c01d
ci: docDB int test wait for appsmith health before cypress (#26655) 2023-08-25 15:27:48 +05:30
Shrikant Sharat Kandula
56c6aa0f1d
ci: Include info.json for all workflows (#26429) 2023-08-22 10:34:23 +05:30
Shrikant Sharat Kandula
d88c4b9c8f
ci: Use default CS URL for DPs (#25938)
For DP images, this now defaults to release-cs, so we don't need to
explicitly set this anymore.

This can be confirmed by running the following:

```
image=appsmith/appsmith-dp:ce-25909
docker pull "$image"
docker image inspect "$image" --format '{{join .Config.Env "\n"}}' | grep CLOUD_SERV
```
2023-08-16 17:29:10 +05:30
Sumesh Pradhan
be9c935732
ci: Deploy preview from branch (#25846)
Updated ad-hoc dp workflow to update the db with progress.
- This workflow should only be called via internal ops api.
- This workflow uses the internal ops api to patch data with the updates
on the workflow statuses.

---------

Co-authored-by: Shrikant Sharat Kandula <shrikant@appsmith.com>
2023-08-07 10:59:42 +05:30
Shrikant Sharat Kandula
692a9f4370
chore: Update generate_info_json.sh 2023-08-04 06:38:16 +05:30
Goutham Pratapa
bc24d03dbd
Revert "update: migrate dp from sts to deployments (#25615)" (#25996)
This reverts commit 6762d2ce90.
2023-08-03 23:40:06 +05:30
Goutham Pratapa
4ea8c95d9a
fix: dp deployments (#25992) 2023-08-03 20:57:47 +05:30
Goutham Pratapa
cf6d9a6e93
fix: failing deploy-preview job (#25990) 2023-08-03 20:23:22 +05:30
Goutham Pratapa
f9efcd29e0
update: dp with deployments style (#25988) 2023-08-03 19:56:23 +05:30
Goutham Pratapa
d4e7fd7bab
fix: failing deploy-preview (#25986) 2023-08-03 19:29:24 +05:30
Goutham Pratapa
6762d2ce90
update: migrate dp from sts to deployments (#25615) 2023-08-03 19:02:17 +05:30
Shrikant Sharat Kandula
e81c06359d
chore: Include tag information, if any in info.json (#25952) 2023-08-03 16:57:04 +05:30
Shrikant Sharat Kandula
e8c3cc19a2
chore: Add info.json to Docker images (#25948)
This adds a `/opt/appsmith/info.json` file to Docker images, with the
following sample content:

```json
{
  "commitSha": "0521ba2c0d7a62cef3d4def66fc15b59cc34ceef",
  "commitUrl": "0521ba2c0d",
  "branch": "release",
  "date": "2023-08-02T12:52:53+00:00",
  "isCI": false
}
```

We're enabling this only for images built for DPs currently, and will
then extend to other workflows as well.

Notice that we copy `info.*json` instead of `info.json`. The reason is
so that the Docker build doesn't fail, even if the `info.json` file
doesn't exist. This lets us publish this to each workflow in turn,
slowly and carefully.

[Relevant Slack
conversation](https://theappsmith.slack.com/archives/C02MUD8DNUR/p1686197957141419).
2023-08-02 18:36:59 +05:30
Shrikant Sharat Kandula
24ee7f777f
chore: Add support for custom CS URL in local_testing.sh script (#25927)
Slack thread with details:
https://theappsmith.slack.com/archives/CGBPVEJ5C/p1690917878540839?thread_ts=1690866395.690119&cid=CGBPVEJ5C
2023-08-02 11:46:28 +05:30
Sumesh Pradhan
18b26a4ec5
ci: Ad-hoc DP | Build Push Deploy from branch (#25357)
Workflow and script to build from branch and deploy to uat-cluster.

---------

Co-authored-by: Shrikant Sharat Kandula <shrikant@appsmith.com>
2023-07-31 13:27:47 +05:30
Goutham Pratapa
160aa162ea
chore: bump helm chart version (#24357)
Completes: [24356](https://github.com/appsmithorg/appsmith/issues/24356)
2023-06-20 10:53:45 +05:30
Goutham Pratapa
a3cab20ac3
chore: decrease pvc volume to enable more dps (#24339) 2023-06-12 09:51:32 +05:30
Valera Melnikov
9f607d250d
chore: move local dependency to packages (#23395)
## Description
1. Move everything related to client from app folder to client folder
(`.yarn`, `yarn.lock`, package.json, .gitignore)
2. Move `ast` and `rst` to client packages
3. Fix running scripts in packages
4. Add running unit tests in packages in CI

TODO: It is necessary to consider enabling the `nmHoistingLimits:
workspaces` option, since now all packages are hoisted to the root,
there may be issues with dependencies in workspaces. Also, there is a
possibility of implicit use of packages.

https://yarnpkg.com/configuration/yarnrc#nmHoistingLimits

#### PR fixes following issue(s)
Fixes #23333

#### Type of change
- Chore (housekeeping or task changes that don't impact user perception)

## Testing

#### How Has This Been Tested?
- [x] Manual
- [x] Jest
- [x] Cypress

## Checklist:
#### Dev activity
- [x] My code follows the style guidelines of this project
- [x] I have performed a self-review of my own code
- [ ] I have commented my code, particularly in hard-to-understand areas
- [ ] I have made corresponding changes to the documentation
- [x] My changes generate no new warnings
- [ ] I have added tests that prove my fix is effective or that my
feature works
- [ ] New and existing unit tests pass locally with my changes
- [ ] PR is being merged under a feature flag

Co-authored-by: Valera Melnikov <melnikov.vv@greendatasoft.ru>
2023-05-22 15:55:46 +03:00
Goutham Pratapa
9a42aff4c3
fix: delete dps of closed PRs (#22979) 2023-05-05 13:51:25 +05:30
Goutham Pratapa
bdeb9176c2
add recreate option in helm upgrade 2023-04-21 17:03:56 +05:30
Goutham Pratapa
f32623420e
ci: uncomment debug statements and clear dps when merged (#22463)
Succesful run:
https://github.com/appsmithorg/appsmith/actions/runs/4718116171/jobs/8367371248
2023-04-17 15:45:52 +05:30
Goutham Pratapa
a835909525
Fix failing cleanup dp (#22462) 2023-04-17 11:51:42 +05:30
Goutham Pratapa
6bbcbc1b2c
ci: add workflows to cleanup merged deploy-previews (#20627)
[20765](https://github.com/appsmithorg/appsmith/issues/20765)
2023-04-17 11:39:33 +05:30
Goutham Pratapa
9b37810c7b
ci: add recreate option for dps (#22091)
fixes: [248](https://github.com/appsmithorg/cloud-deployment/issues/248)


https://github.com/appsmithorg/appsmith-ci/pull/14#issuecomment-1504569726
This doesnt delete the existing stacks 


https://github.com/appsmithorg/appsmith-ci/pull/14#issuecomment-1504842238
this deletes the stack, database in mongo and therefore creating a
complete new stack
2023-04-14 16:27:17 +05:30
Goutham Pratapa
898d0010f3
chore: add sentry variables to DP (#21901) 2023-04-14 10:47:45 +05:30
Goutham Pratapa
17fe14628f
ci: add release-portal url for deploy-previews (#21140)
Add env variable APPSMITH_CLOUD_SERVICES_BASE_URL to make sure the
licence_key generation requests hit only release-cs i.e
"https://release-cs.appsmith.com/" and not production-cs
"https://cs.appsmith.com/"
2023-03-21 10:54:54 +05:30
Goutham Pratapa
47750db727
ci: add comments for vercel-deploy-preview (#21349)
**/build-deploy-preview env=release**

![Screenshot 2023-03-14 at 9 49 44
AM](https://user-images.githubusercontent.com/15846947/224892349-588b3460-0b8d-4937-9b94-4013d03275a0.png)

---------

Co-authored-by: Shrikant Sharat Kandula <shrikant@appsmith.com>
2023-03-16 17:32:32 +05:30