Categories: Cortana

Cortana and Third-Party Services – Foursquare Today… More to Come in the Future


Have you watched the movie “Her”? I think many aspects of the OS’s design in the movie will eventually find their way in personal assistants. Some already are here… “

I do believe that, in the not-so-distant future, personal assistant experiences such as Cortana will be the primary human-computer interface for consuming information and interacting with services on the Internet (see “Convergence of User Experiences“). Integration with third-party services is one of the key capabilities necessary in realizing the vision of seamless task completion experiences, enabling the users do more through technology! Today Cortana made yet-another important step towards achieving that goal: integration with Foursquare.

Back in April, when we revealed Cortana to the world, I wrote about the role of the Bing platform as her enabling force. Recently, during a talk at the School of Computing Science, University of Newcastle, I gave more details about how the cloud enables Cortana (slides also embedded below). Our cloud platform allows us to quickly fix any issues, learn, and evolve our speech, natural language, and inference models. We keep an eye on which features work and which ones don’t. We take corrective actions to make sure that Cortana provides the best user experience possible. Furthermore, we are able to introduce new features and experiences in a continuous, agile fashion. And all these without the need to update the Windows Phone OS.

Elan Levy wrote about a brand new feature we introduced earlier today… a Foursquare-powered card that offers “best nearby” suggestions. This isn’t the first time Cortana gets a new capability since her introduction to the world back in April. There have been numerous updates, as many of you have already noticed. However, today’s announcement represents Cortana’s first attempt to directly integrate with a third-party service. While it has been possible, from the very beginning, to launch third-party apps on the phone using voice commands, this is the first time we surface an experience that is directly powered by a third-party service. The “best nearby” feature will allow us to learn, mostly on the operational front (e.g. reliability, latency, traffic bandwidth, etc), what it means to directly integrate with a third-party service. The integration is basic and non-personalized at the moment but be assured that much more is coming on multiple fronts.

With Cortana now rolling out to Windows Phones across mobile operators in the US and with some international releases imminent, please give the feature a go and let us know what you think. Feel free to drop me a message if you prefer.

Savas Parastatidis

Savas Parastatidis works at Amazon as a Sr. Principal Engineer in Alexa AI'. Previously, he worked at Microsoft where he co-founded Cortana and led the effort as the team's architect. While at Microsoft, Savas also worked on distributed data storage and high-performance data processing technologies. He was involved in various e-Science projects while at Microsoft Research where he also investigated technologies related to knowledge representation & reasoning. Savas also worked on language understanding technologies at Facebook. Prior to joining Microsoft, Savas was a Principal Research Associate at Newcastle University where he undertook research in the areas of distributed, service-oriented computing and e-Science. He was also the Chief Software Architect at the North-East Regional e-Science Centre where he oversaw the architecture and the application of Web Services technologies for a number of large research projects. Savas worked as a Senior Software Engineer for Hewlett Packard where he co-lead the R&D effort for the industry's Web Service transactions service and protocol. You can find out more about Savas at https://savas.me/about

Recent Posts

BrainExpanded – The Timeline

See "BrainExpanded - Introduction" for context on this post. Notes and links Over the years,…

2 days ago

BrainExpanded – Introduction

This is the first post, in what I think is going to be a series,…

2 days ago

Digital twin follow up

Back in February, I shared the results of some initial experimentation with a digital twin.…

1 week ago

Digital Twin (my playground)

I am embarking on a side project that involves memory and multimodal understanding for an…

10 months ago

“This is exactly what LLMs are made for”

I was in Toronto, Canada. I'm on the flight back home now. The trip was…

1 year ago

AI is enhancing me

AI as an enhancer of human abilities.

1 year ago