Skeleton-of-Thought: Parallel decoding speeds up and improves LLM output
This research was accepted by the 2024 International Conference on Learning Representations. Large language models (LLMs) such as LLaMA and OpenAI’s GPT-4 are revolutionizing technology. However, one of the common complaints about LLMs is their…
The Azure Cognitive Services on Spark: Clusters with Embedded Intelligent Services | Spark Summit Europe 2018
We present the Azure Cognitive Services on Spark, a simple and easy to use extension of the SparkML Library to all Azure Cognitive Services. This integration allows Spark Users to embed cloud intelligence directly into…
Apache Spark Serving: Unifying Batch, Streaming, and RESTful Serving | Spark Summit Europe 2018
We present Spark Serving, a new spark computing mode that enables users to deploy any Spark computation as a sub-millisecond latency web service backed by any Spark Cluster. Attendees will explore the architecture of Spark…
Deep Reality Simulation for Automated Poacher Detection | Spark Summit Europe 2018
We present a novel deep learning approach to create a robust object detection network for use in an infra-red, UAV-based, poacher recognition system. More specifically we have used Microsoft AirSim to generate thousands of hours…
Unsupervised Object Detection Using the Azure Cognitive Services on Spark | Spark Summit Europe 2018
We present HTTP on Spark, a novel integration between Spark with the widely used Hypertext Transfer Protocol (HTTP). This library can be used to integrate any framework into the Spark ecosystem that is capable of…
Cognitive Services with Synapse ML
Operationalizing Machine Learning and Artificial Intelligence can be a challenge for data engineers. In this session we explore how SynapseML simplifies the process of leveraging Azure Cognitive Services as part of a data engineering process…
Synapse Espresso: Data Quality Checking with OpenAI GPT-3 in Azure Synapse Spark!
Welcome to the 24th episode in our Azure Synapse Espresso series! In this video, Thomas joins Stijn to show how we can clean our data using the Azure OpenAI GPT-3 from within Spark in Synapse Analytics.…
Synapse Espresso: Using OpenAI GPT-3 in Synapse!
Welcome to the 22nd video in our Synapse Espresso series! In this video, Thomas joins Stijn to show how we can make use of Azure OpenAI GPT-3 from within Spark in Synapse Analytics. GPT-3 is…