follow us on
reach us on app store
News18 English
3-MIN READ

We Asked Microsoft's CaptionBot to Describe Some Famous Photos and ...

We Asked Microsoft's CaptionBot to Describe Some Famous Photos and ...

Microsoft's CaptionBot attempts to recognise objects and faces in images and describe it in natural language (sometimes punctuated with emoji).

  • IBNLive.com
  • Last Updated: April 15, 2016, 5:19 PM IST
Share this:

Undeterred by the embarassing setback involving its Tay chatbot, Microsoft has launched a new addition to its range of fun artificial intelligence tools. Microsoft's CaptionBot attempts to recognise objects and faces in images and describe it in natural language (sometimes punctuated with emoji).

CaptionBot uses computer vision and natural language to describe contents of images "as well as any human" but accepts that it is still learning and can get things wrong.

To help CaptionBot learn (as it is supposed to get better as more people use it) and to test how good it is at its job, we fed it with some famous images and here's what happened:

01-captionbot01-captionbot

Original caption: Indian fans in the crowd celebrate as a Pakistan wicket falls during the 2015 ICC Cricket World Cup match between India and Pakistan at Adelaide Oval on February 15, 2015 in Adelaide, Australia.

(Photo by Scott Barbour/Getty Images)

02-captionbot02-captionbot

Original caption: The Beatles and their wives at the Rishikesh in India with the Maharishi Mahesh Yogi, March 1968. The group includes Ringo Starr, Maureen Starkey, Jane Asher, Paul McCartney, George Harrison (1943 - 2001), Patti Boyd, Cynthia Lennon, John Lennon (1940 - 1980), Beatles roadie Mal Evans, Prudence Farrow, Jenny Boyd and Beach Boy Mike Love.

(Photo by Hulton Archive/Getty Images)

03-captionbot03-captionbot

Original caption: The India team celebrate their victory as the ICC Twenty20 World Champions during the final match of the ICC Twenty20 World Cup between Pakistan and India held at the Wanderers Cricket Stadium on September 24, 2007 in Johannesburg, South Africa.

(Photo by Duif du Toit/Gallo Images/Getty Images)

04-captionbot04-captionbot

Original caption: Catherine, Duchess of Cambridge and Prince William, Duke of Cambridge meet Prime Minister of India Narenda Modi in New Delhi's Hyderabad House on April 12, 2016 in New Dehli, India.

(Photo by Dominic Lipinski - Pool/Getty Images)

05-captionbot05-captionbot

Original caption: Citizens celebrate India's independence from British rule in the streets of Calcutta.

(Photo by Keystone/Getty Images)

06-captionbot06-captionbot

Original caption: Virat Kohli of India celebrates as he reaches his century during the 2015 ICC Cricket World Cup match between India and Pakistan at Adelaide Oval on February 15, 2015 in Adelaide, Australia.

(Photo by Scott Barbour/Getty Images)

07-captionbot07-captionbot

Original caption: Soldiers From India (L) And Pakistan (R) Perform The Elaborate Daily Flag-Lowering Ceremony May 30, 2002 At The Wagah Border Post Near The Pakistani City Of Lahore.

(Photo By Visual News/Getty Images)

08-captionbot08-captionbot

Original caption: The Taj Mahal is seen on September 30, 2010 in Agra, India. Completed in 1643, the mausoleum was built by th Mughal emperor Shah Jahan in memory of his third wife, Mumtaz Mahal, who is buried there alongside Jahan.

(Photo by Julian Finney/Getty Images)

09-captionbot09-captionbot

Original caption: Mahendra Singh Dhoni of India celebrates catching out Lahiru Thirimanne of Sri Lanka during the ICC World Twenty20 Bangladesh 2014 Final between India and Sri Lanka at Sher-e-Bangla Mirpur Stadium on April 6, 2014 in Dhaka, Bangladesh.

(Photo by Gareth Copley/Getty Images)

10-captionbot10-captionbot

Original caption: Charity worker Mother Teresa (1910 - 1997), seen in her hospital around the time she was awarded the Templeton Prize for Progress.

(Photo by Mark Edwards/Keystone Features/Getty Images)

11-captionbot11-captionbot

Original caption: Indian statesmen Mahatma Gandhi (Mohandas Karamchand Gandhi, 1869 - 1948) and Jawaharlal Nehru (1869 - 1964) (left), known as Pandit Nehru, in conversation at the All-India Congress committee meeting at Bombay.

(Photo by Central Press/Getty Images)

12-captionbot12-captionbot

Original caption: Indian nationalist leader Mohandas Karamchand Gandhi (1869 - 1948), popularly known as Mahatma Gandhi, whose policy of peaceful demonstration led India from British rule to independence.

(Photo by Elliott & Fry/Getty Images)

13-captionbot13-captionbot

Original caption: Indian film actor, Amitabh Bachchan poses on stage during the Indian Film Festival of Melbourne Awards at Princess Theatre on May 2, 2014 in Melbourne, Australia.

(Photo by Scott Barbour/Getty Images for IFFM)

14-captionbot14-captionbot

Original caption: Sachin Tendulkar of India celebrates his 50th Test century during day 4 of the 1st Test match between South Africa and India at SuperSport Park on December 19, 2010 in Centurion, South Africa.

(Photo by Duif du Toit / Gallo Images/Getty Images)

15-captionbot15-captionbot

Original caption: A protester chants slogans as she braces herself against the spray fired from police water canons during a protest against the Indian government's reaction to recent rape incidents in India, in front of India Gate on December 23, 2012 in New Delhi, India.

(Photo by Daniel Berehulak/Getty Images)

16-captionbot16-captionbot

Original caption: 2nd April 1929: A demonstration in Madras, India, calling for a boycott of the Simon Commission. The demonstrators are carrying black banners with the slogan 'Simon Go Back'.

(Photo by Keystone/Getty Images)

17-captionbot17-captionbot

Original caption: An Indian flag is flown high during day one of the Fourth Test between Australia and India at Adelaide Oval January 24, 2008 in Adelaide, Australia.

(Photo by Simon Cross/Getty Images)

You can give the CaptionBot a try at captionbot.ai but note that it will store your images.

Share this:

Next Story