PromucFlow_constructor/app/server/appsmith-plugins
Nirmal Sarswat bc3d46d8c1
feat: Vision models support in Anthropic (#32103)
## Description
Adding new vision models support in Anthropic
<img width="1134" alt="Screenshot 2024-04-12 at 15 59 06"
src="https://github.com/appsmithorg/appsmith/assets/25587962/49110b9d-00ee-4210-9d43-bf2a832aee20">

 
Fixes https://github.com/appsmithorg/appsmith-ee/issues/3681

## Automation

/ok-to-test tags="@tag.Datasources"

### 🔍 Cypress test results
<!-- This is an auto-generated comment: Cypress test results  -->
> [!CAUTION]
> 🔴 🔴 🔴 Some tests have failed.
> Workflow run:
<https://github.com/appsmithorg/appsmith/actions/runs/8704175377>
> Commit: 2c393e7ffaf3d08fd8e945761206de76d3a13845
> Cypress dashboard: <a
href="https://internal.appsmith.com/app/cypress-dashboard/rundetails-65890b3c81d7400d08fa9ee5?branch=master&workflowId=8704175377&attempt=3&selectiontype=test&testsstatus=failed&specsstatus=fail"
target="_blank"> Click here!</a>
> The following are new failures, please fix them before merging the PR:
<ol>
> <li>cypress/e2e/Regression/ServerSide/GenerateCRUD/MySQL2_Spec.ts
</ol>
> To know the list of identified flaky tests - <a
href="https://internal.appsmith.com/app/cypress-dashboard/identified-flaky-tests-65890b3c81d7400d08fa9ee3?branch=master"
target="_blank">Refer here</a>

<!-- end of auto-generated comment: Cypress test results  -->







<!-- This is an auto-generated comment: release notes by coderabbit.ai
-->
## Summary by CodeRabbit


- **New Features**
- Enhanced chat functionality with version upgrade and refined message
creation process.
- Added vision-related commands for handling image and text data in the
Anthropic plugin.
    - Expanded constants to support new messaging and vision features.
- Introduced new fields in request models to support system prompts and
messages, while deprecating older fields.
- Implemented a `VisionCommand` in method strategy for better handling
of vision tasks.
- Improved utility functions for message handling and configuration
value extraction.

- **Refactor**
- Streamlined request URI construction to support new vision
functionality alongside chat commands.
    - Removed unused constants and methods to clean up the codebase.

<!-- end of auto-generated comment: release notes by coderabbit.ai -->
2024-04-16 13:41:28 +00:00
..
amazons3Plugin fix: commands title changed to command for each datasource query editor forms (#32526) 2024-04-10 17:05:01 +05:30
anthropicPlugin feat: Vision models support in Anthropic (#32103) 2024-04-16 13:41:28 +00:00
appsmithAiPlugin chore: Add after delete hook for Appsmith AI datasource (#31466) 2024-03-19 12:52:32 +05:30
arangoDBPlugin fix: default port numbers for the datasources (#32592) 2024-04-16 13:29:04 +05:30
awsLambdaPlugin fix: commands title changed to command for each datasource query editor forms (#32526) 2024-04-10 17:05:01 +05:30
databricksPlugin fix: Making userTag a hidden field to not expose it as a user configurable option with Appsmith being the default value (#31792) 2024-03-14 16:18:44 +05:30
dynamoPlugin chore: Applied Spotless formatter (#25173) 2023-07-07 00:43:11 +05:30
elasticSearchPlugin fix: default port numbers for the datasources (#32592) 2024-04-16 13:29:04 +05:30
firestorePlugin fix: commands title changed to command for each datasource query editor forms (#32526) 2024-04-10 17:05:01 +05:30
googleAiPlugin fix: commands title changed to command for each datasource query editor forms (#32526) 2024-04-10 17:05:01 +05:30
googleSheetsPlugin fix: gsheet query UI doesnt load on change of command fixed (#32427) 2024-04-05 13:56:44 +05:30
graphqlPlugin test: Fix GraphQL test waiting for the wrong status code on TED 2024-04-01 18:53:10 +05:30
jsPlugin chore: Applied Spotless formatter (#25173) 2023-07-07 00:43:11 +05:30
mongoPlugin fix: default port numbers for the datasources (#32592) 2024-04-16 13:29:04 +05:30
mssqlPlugin fix: default port numbers for the datasources (#32592) 2024-04-16 13:29:04 +05:30
mysqlPlugin fix: default port numbers for the datasources (#32592) 2024-04-16 13:29:04 +05:30
openAiPlugin chore: Fix warnings on @EqualsAndHashCode (#32667) 2024-04-15 13:46:37 +05:30
oraclePlugin fix: default port numbers for the datasources (#32592) 2024-04-16 13:29:04 +05:30
postgresPlugin fix: default port numbers for the datasources (#32592) 2024-04-16 13:29:04 +05:30
redisPlugin fix: default port numbers for the datasources (#32592) 2024-04-16 13:29:04 +05:30
redshiftPlugin fix: default port numbers for the datasources (#32592) 2024-04-16 13:29:04 +05:30
restApiPlugin test: Add AssertJ for plugins, for better assertions (#31380) 2024-03-04 07:33:45 +05:30
saasPlugin chore: Applied Spotless formatter (#25173) 2023-07-07 00:43:11 +05:30
smtpPlugin fix: default port numbers for the datasources (#32592) 2024-04-16 13:29:04 +05:30
snowflakePlugin feat: Add isSuggested value to templates for all plugins (#26623) 2023-08-30 11:49:25 +01:00
pom.xml test: Add AssertJ for plugins, for better assertions (#31380) 2024-03-04 07:33:45 +05:30