feat: added script to export antlr tokens to use in frontend editor

[tolgadur]

Jira: KCI-170

Description

Query editor in the UI was missing a lot of ANTLR tokens in the highlighting and autocomplete such as LIST or DESCRIBE. This function is extracting the ANTLR tokens and is called by a script in the frontend to update the ui automatically.

Testing done

I wrote a unit test for the method to ensure that the tokens are correctly extracted.

Reviewer checklist

• Ensure docs are updated if necessary. (eg. if a user visible feature is being added or changed).
• Ensure relevant issues are linked (description should include text like "Fixes #")

[ghost]

It looks like @tolgadur hasn't signed our Contributor License Agreement, yet.

The purpose of a CLA is to ensure that the guardian of a project's outputs has the necessary ownership or grants of rights over all contributions to allow them to distribute under the chosen licence.
Wikipedia

You can read and sign our full Contributor License Agreement here.

Once you've signed reply with [clabot:check] to prove it.

Appreciation of efforts,

clabot

[tolgadur]

[clabot:check]

[ghost]

@confluentinc It looks like @tolgadur just signed our Contributor License Agreement. 👍

Always at your service,

clabot