The social network shared AI and VR news that it hopes will signal the next wave of its own innovation, creating a new standard for the online social experience.
Day 2 of Facebook's F8 conference was artificial intelligence day on the waterfront at Fort Mason in San Francisco, where about 3,000 developers and some interloping journalists were hanging out April 13 on a picturesque day.Oh yes, there also were about 1 million people watching the proceedings via the Webcast, wishing they were at the conference.The social network shared artificial intelligence and virtual reality news that it hopes will signal the next wave of its own innovation, creating a new standard for the online social experience that will include all types of e-commerce. Facebook's Applied Machine Learning team runs this Facebook functionality, and they've been doing a heck of a lot of work.Here are some key data points from Day 2 of the conference. Artificial Intelligence Facebook demonstrated that its AI can do some useful things, such as provide descriptions of photos to sightless people; analyzing a photo of a mole to determine if it could be cancerous; and organize a person's Facebook News Feed.Because F8 is a developers' conference, the company was very forthcoming in offering under-the-hood demonstrations about how its AI is powering different Facebook experiences. Here are some use cases:--Translation: Today, 50 percent of the Facebook community does not speak English, and most people don't speak each other's languages. To remove these communication barriers the team, built an AI-based automatic translation system that helps a whopping 800 million people every month see translated posts in their news feed.--Photo Image Search: Using Facebook's automatic image classifiers, one can imagine a scenario where someone could have the ability to search through all photos friends have shared to look for a particular one based on the image content, instead of relying on tags or surrounding text. --Talking Pictures: Facebook is currently doing research that breaks images open and understands them at the individual pixel level, rather than simply classifying the entire image. This is called image segmentation, and it allows the social network to recognize individual objects in the image as well as their relation. Using image segmentation, Facebook will be able to build more immersive experiences for the blind with so-called "talking images" that can be read with fingertips, in addition to offering more powerful ways to search images.--Real-Time Video Classification: In order to build the tools to organize content people want to see, the team needed to be able to classify live videos on the fly in real time. In real time, computer vision techniques can open videos and classify what's in them without using tags or surrounding content.Data privacy through all of this is a topic that will need to undergo a lot more discussion.Social Virtual RealityFacebook wants people to be able to interact with anyone else, no matter where they are in the world, through virtual reality. Facebook CTO Mike Schroepfer sowed onstage how he was able to join Michael Booth, a leader of the social VR team, in the same virtual space as the duo toured London together (see photo).See eWEEK's April 12 story about Facebook's forways into VR.Aquila, the Facebook DroneFacebook's cloud-controlled drone made its debut at the 2015 F8 conference. However, the company's been working hard on improving it. The flying computer, weight less than a small car, is designed to fly at an altitude of 60,000 feet and stay airborne for several months at a time.CEO and co-founder Mark Zuckerberg mentioned it during his 10-year roadmap talk on April 12."If you had told me Facebook was going to build a plane I would have told you you were crazy," Zuckerberg said.Live Video Streaming Open to AllFacebook has opened its API (application programming interface) for live video, so that users can stream live video from various objects. The company last week opened this functionality for users to broadcast live video to specially designated groups.Facebook launched Live last summer to public figures via the Mentions app and more recently to everyone in the U.S. using its iOS and Android apps. The Live app enables users to stream live videos shot on iPhones and various Android phones directly into their own News Feeds on their Facebook pages.Now anybody can do it. Zuckerberg demonstrated by showing live video being streamed to Facebook from a drone that flew around inside the Fort Mason building.Facebook Account KitFacebook is even helping to rid IT of those infernal passwords we all tend to forget. Its new Account Kit gives users the choice to log into new apps by using a phone number or email address, something that's already burned into our brains. The new feature could help developers reach new audiences with their apps, according to Facebook.Facebook Connectivity LabFacebook wants everybody in the world to not have to worry about Internet connectivity -- and, naturally, they need connectivity to use the social network. With its new Connectivity Lab, Facebook debuted two new ground-based systems for boosting Internet access around the globe.The first one, Terragraph, is a wireless system that will be deployed only in urban areas in small nodes on urban furniture, according to the company. It will debut in its first test market of San Jose, Calif., later this year, Zuckerberg said.The second, called Aries, is a proof-of-concept research project designed to cover vast areas with low population density. No timetable for deploying Aries was announced.
- eWeek