PaLM API

Google Cloud’s PaLM API is a new developer offering to make it easier and safer to experiment with Google’s large language models.

The PaLM API can be used for a variety of applications and provides access to models that are optimized for multi-turn use cases— such as content generation and chat, and general purpose models that are optimized for areas such as summarization and classification.

With embeddings generated through the PaLM API, developers will be able to build applications with their own data or on top of external data sources. Embeddings can also be used in downstream applications built with TensorFlow, Keras, JAX, and other open-source libraries.

Google’s infrastructure supports PaLM API so users don’t have to worry about hosting or serving. Select developers can access the PaLM API today.

“We’re making an efficient model available, in terms of size and capabilities, and we’ll add other sizes soon,” said Kurian. “The API also comes with an intuitive tool called MakerSuite, which lets you quickly prototype ideas and, over time, will have features for prompt engineering, synthetic data generation, and custom-model tuning — all supported by robust safety tools.”