Caila platform documentation Blog https://docs.caila.io/en/blog Caila platform documentation Blog Sun, 20 Oct 2024 00:00:00 GMT https://validator.w3.org/feed/docs/rss2.html https://github.com/jpmonette/feed en <![CDATA[Release 20.10.2024]]> https://docs.caila.io/en/blog/2024/10/20/release https://docs.caila.io/en/blog/2024/10/20/release Sun, 20 Oct 2024 00:00:00 GMT Full list of services the resource group​

Now on the “Services” tab in the resource group, you can see both running services and all services attached to this resource group. For convenience, the coloured indicator of status is displayed next to each service. Additionally, wherever the number of servers is displayed, it is appended by status, like 5(active) / 10(assigned), which helps quickly assess the state of services.

Auto-refresh for server cost information​

On the server selection page, the cost now updates dynamically depending on the selected option. Previously, static information was provided, which could confuse users. Now the actual price is always displayed, making it easier to make decisions.

Request cost added in multi-chat​

The display of request cost has been added in multi-chat. The cost can be displayed in pounds or tokens, depending on the settings, enabling you to always see the current expenses directly in the interface.

Resource pools and quotas​

We have introduced resource pools and quotas, giving you better control and monitoring over resource usage on your account. This will help optimise usage and prevent exceeding available limits.

Welcome bonus for new and current users​

To enhance the platform experience, all new users now receive a welcome bonus of 5 pounds upon registration. The bonus was awarded to all existing users.

]]> <![CDATA[Release 09.09.2024]]> https://docs.caila.io/en/blog/2024/09/09/release https://docs.caila.io/en/blog/2024/09/09/release Mon, 09 Sep 2024 00:00:00 GMT Server information for external connections​

Now, when adding an external connection, you can add a comment to quickly locate the necessary models on external servers. Comments may include the date and server information, for example: OP-XYZ Launched on rndbox5 from 01.02.2024

Markdown is now supported in GPT-Viewer​

Markdown is now supported in GPT-Viewer. It enables formatting text for convenient display, enhancing the perception of information when working with data.

Server configuration: added billing period​

When selecting a server configuration, the period of billing is now displayed in addition to the price. For example, £1 per month or another period. This makes the cost of the service clearer.

]]> <![CDATA[Llama 3.1]]> https://docs.caila.io/en/blog/2024/08/19/llama-3.1 https://docs.caila.io/en/blog/2024/08/19/llama-3.1 Mon, 19 Aug 2024 00:00:00 GMT Two versions of services based on Llama 3.1 have appeared in the Caila catalogue. The services are provided for introductory and testing purposes.

The availability of services is permanent.

llama3.1-8b​

Using checkpoint: meta-llama/Meta-Llama-3.1-8B-Instruct.

Inference engine: vllm.

GPU: 1×3090 (at the time of publication)

llama3.1-70b-4q​

Using checkpoint: hugging-quants/Meta-Llama-3.1-70B-Instruct-AWQ-INT4.

Inference engine: vllm.

GPU: 4×3090 (at the time of publication)

]]> <![CDATA[Documentation portal update]]> https://docs.caila.io/en/blog/2024/08/01/new-docs https://docs.caila.io/en/blog/2024/08/01/new-docs Thu, 01 Aug 2024 00:00:00 GMT The caila.io documentation site has moved to a new engine and has been updated with new articles.

]]>