Sunday, November 23, 2014

Using Augmented Reality to Advance Medical Education



Instructors and students in the medial field have unique challenges when it comes to teaching and learning. While both medical school and professional development both require intensive reading from textbooks and journals, or dissection of cadavers, these ways of learning feel disconnected from the human element, are not holistic, and in the case of the use of cadavers, can very expensive. Per a review in the September 2014 issue of the journal Perspectives in Medical Education, current instructional best practices recommend "whole-task training" as the most effective method of meaningful learning, and augmented reality provides the perfect tools to achieve this.

For example, from the aforementioned review comes the story of several innovative ways that the education of anatomy is being enhanced through augmented reality. The Miracle Mirror System (PDF) gives users a virtual look at their own internal anatomy. The system uses the Microsoft Kinect technology to display real-time video of the user on a screen and track his or her movements, then displays 3D graphics of internal anatomical features onto the user's own image. The user can interact with the images and view text about the anatomy. Not only could this technology provide a new avenue for anatomy education, it also could be used for patient education and educating the general public in a new and engaging way.

Augmented reality has also been used to view lung function and interaction in 3D, and to train surgeons on laparoscopic surgical techniques. The field of medicine appears ripe with opportunity to integrate augmented reality.

Photo by Dr.Farouk from Flickr under Creative Commons.

Thursday, November 20, 2014

High Fashion and Augmented Reality


It's no surprise that the fashion world is jumping on revamping the look of tech devices such as fitBit and Google Glass. Those that can afford trendy tech gadgets are usually those that may spend a little more on high fashion.

Diane Von Furstenberg, a fashion icon, revealed her version of the Google Glasses at London Fashion Week. These glasses are now available for $1800. With a lot of talk about how Glass looks, it is interesting to see Google looking to partner with different companies and designers to better the look.

Wearable augmented reality is a natural match for designers. Fashion designer Marga Weimans launched a first ever augmented reality dress in Amsterdam Fashion Week 2013. The hyperfabric dress allowed the dress to be updated from a distance, making it possible to adapt based on geolocation or change of season.

Augmented reality is changing a lot on both the tech and social aspects of society and there is a lot left to be seen. I expect there to be more collaboration between the fashion and tech world.

Tuesday, November 18, 2014

Perceptions on Augmented Reality Glasses and the Recording Feature


Perceptions on Augmented Reality Glasses and the Recording Feature

Written by Dan Cyr

In a recent field study conducted by the University of Washington, researchers performed 23 sessions with 31 participants over a 3 and a half month time period. These in promptu, qualitative sessions in a local café in Seattle yielded interesting results[1].
Prior to the interviews, a researcher would sit in the café with a pair of augmented reality glasses on. After a while, the research team would sit and interview various individuals asking them questions like “Did you notice the glasses that he or she was wearing” and “Did you know that those glasses can video record actions?” The results from the field study provided rather interesting conclusions.

11 of the 31 participants didn’t even notice someone was wearing augmented reality glasses in the café. Another interesting note is that 28 of the 31 participants either acted indifferent or negative to this type of technology. People were concerned with being recorded and privacy but mentioned how they are being recorded at all times. They mentioned CCTV and traffic cameras. Being in Seattle, there are CCTV’s all around. One participant mentioned, “It’s a bit like Big Brother but we accept it as a society, and it’s not like you’re in a house.” Are people really starting to accept what the future has in store for products like Google Glass?
Taking a look at the data a little deeper, the place in which a person is wearing the glasses plays an integral role. The difference between a “private” and “public” place is a fine line. Participants mentioned places like the bathroom and other people’s homes as not being suitable places to film which coincide with legal restrictions. The perception of the recorder or person with the glasses was interesting as well. If they looked “normal” to the bystander then they were fine. If they looked like a “pervert” in their eyes then it was a negative connotation. Other factors like being identified if they are a foster child or person in protective custody and proximity to the recorder also played an important role.

Many other interesting insights were gleaned from the field study around buying a product to block recording and design considerations for augmented reality glasses. More of this study can be read here.



[1] Denning, T. et al. 2014. In Situ with Bystanders of Augmented Reality Glasses: Perspectives on Recording and Privacy mediating Technologies. Proceedings of the 32Nd Annual ACM Conference on Human Factors in Computing Systems (New York, NY, USA, 2014), 2377–2386.

Wednesday, November 12, 2014

Augmented Reality and Privacy Concerns: What Will the Law Have to Say


Augmented Reality and Privacy Concerns: What Will the Law Have to Say

 Written by Dan Cyr

With augmented reality becoming ever more “real” as the years pass by, what is the use of wearable glasses and other devices have on our human rights and laws that protect us? When it comes to augmented reality, there are “inputs” which capture and record the environment and “outputs” that overlay information over the actual environment in focus. In general, augmented reality senses properties about the real world, processed data in real time, recognizes real world object and outputs information to the user. How will this technology affect our privacy and sense of security?
Upon further review of the legal concerns and our rights here in the states, I came across a research paper by the UW Tech Policy Lab and Computer Science team at the University of Washington[1]. When it came to the collection or “input” of data from an augmented reality device, the following issues were found:
·       Today the courts treat nearly any expectation of privacy in public as unreasonable. But technologies such as GPS and drones that are capable of widespread or constant surveillance at low cost are testing the limits of this doctrine. AR will put additional pressure on this cracking edifice because it has the potential to record persistently, source and present related information from various sources to users, and blend seamlessly into the environment.
·       American constitutional law also assumes no reasonable expectation of privacy in information conveyed to a third party. AR has the potential to convey one’s entire stream of observation to a company for analysis and storage, with unclear constitutional import. Design choices about whether to store data locally or in the cloud (or to provide user with a choice) directly affect the level of legal privacy protections afforded that information vis-à-vis the user.
·        Historically, free speech interests have involved the right to express oneself in various media. AR tests the limits of a burgeoning free speech right, recognized by a handful of courts, to photograph public officials or matters of public interest.
·       AR complicates intellectual property law by gathering and potentially transforming copyrighted or trademarked material that appears in the real world. For example, recording copyrighted material likely constitutes copying, for purposes of copyright infringement, at the moment of capture—as well as when copies are saved to external (temporary or permanent) storage. Of course, the usual defenses to infringement (e.g., fair use) apply in these scenarios, but the potentially pervasive and persistent sensing of copyrighted material by AR technologies, combined with manipulation or output issues, raises difficult new questions about how existing intellectual property law will apply to new situations made possible my AR.
·       The form factor of recording equipment has an effect on rulings in the legal landscape. In areas where there is a reasonable expectation of privacy, the presence of obvious recording equipment—like a shouldercam—is considered to serve as a cue that recording may be taking place. While early AR rigs— such as those worn by Steve Mann or Thad Starner— were fairly obvious, modern AR systems are leaning towards more inconspicuous form factors. This, in turn, can have an effect on legal rulings regarding captured footage.
·         AR systems might also be designed to allow remote environmental triggers to control when sensing capabilities should be disallowed (for example, a movie theater may limit the ability of devices to record while a movie is screening). This possibility raises novel questions about limits on First Amendment information gathering rights, device ownership, intellectual property protections, and personal privacy.
 
When it comes to the output or display of the data, the following issues have been raised:
·       Users of AR may rely upon data that leads to their injury or other harm. Information provided to AR users may be false, incomplete, or misleading. Scenarios range from obscuring a road sign or distracting a driver, to misidentifying a plant or mushroom as safe to eat or failing to inform a user when a potentially dangerous situation is sensed by the technology. This capacity will test the limits of product liability law, among other areas, and the specific design of these systems (e.g., whether they are designed for specific or general purposes) may alter the legal outcomes.
·       AR can furnish users with truthful information they should not have, or at least that they cannot legally use to make decisions. Thus, for instance, a system could use facial recognition to pull up a job candidate’s mug shot, social media profile, or relationship status in a jurisdiction that does not permit employers to discriminate based on arrest history, marital status, or other information that may be available through technological intervention. Thus, the use of AR could contribute to forms of illegal discrimination, raising possible legal liability for users and developers.
·       AR could even prove the source of a new category of “digital assault,” i.e., intentional interference with an AR user to cause fear or other harm. Tort law purports to cover such transgressions, but there are next to no test cases to date. There are, however, preliminary examples—for instance, hacking a website for epileptics to attempt to induce seizures, or advertising for exterminator services by creating the illusion that a spider has run across the user’s screen. These factors suggest that the use of AR to surprise, scare, or harm an AR user (particularly when the technology can sense the user is in a vulnerable situation; for example, while driving a car or when the person is depressed or unhappy) may lead to potential liability for something akin to digital assault.
 
So what does this all mean? This means that there are plenty of hours and negotiations left in the works for augmented reality companies and lawyers. Privacy is a basic necessity that most of us crave as human beings. Companies need to respect that in order to make their sales.



[1] Roesner, F., et.al., Augmented Reality: Hard Problems of Law and Policy ACM International Joint Conference. Proc. Pages 1283-1288 http://dl.acm.org/citation.cfm?doid=2638728.2641709
 

Saturday, November 8, 2014

A self centered society and the introduction of AR



There was a time when people had no choice but to socialize with strangers on trains and on bus stops or waiting in line at the store. These days we are so glued to our devices we are missing many opportunities to not only talk to new people, but talk to the people already in our lives.

It seems that technology has robbed us of the ability to socially interact with people the same way we once did. I believe with the growth of wearable AR devices it will only get worse. These devices may have a beneficial impact on learning, medicine, and other areas, but like many technologies, overuse will only make our day to day social lives worse. According to a Pew study 30% have used their phone to avoid interacting with the people around them.(http://www.pewinternet.org/2011/08/15/americans-and-their-cell-phones/)

I've personally done it. I've seen someone I didn't feel like saying hi to and looked down at my phone pretending to be occupied to avoid the interaction. People could have used a magazine or other sort of distraction in the past, but having smart phones has made it easier. We've become to reliant on these devices, we do not know how to behave without them.

We are, generally speaking, self centered people. We are consumed with broadcasting our positive moments and with taking our selfies and publishing the best ones. I don't know that the selfish and narcissistic behavior is all to blame on technology but our society is much more "me" driven  than it once was and the use of technology to avoid social interactions is increasing. It may not even be intentional.

I've heard of people bumping into things because they are looking down at their phone and not paying attention and we have all heard about how many car accidents happen because people are texting. There are obvious and less obvious social behaviors that are being dramatically impacted by our self centeredness and our distraction.
I still look at people with bluetooth devices on their ear funny. I am as addicted to my phone as the next guy, but I find it strange when someone attends a social event with a piece of technology stuck to their ear. I find the same thing to be true about Google Glass.

I think much of the negative backlash Glass got was because people didn't trust it. How did someone know you weren't taking photos of them as you sat to have dinner together? It's so much more obvious with the phone. People are nervous that those wearing AR devices might be recording and will post on social media. There is a fear that you are being recorded without knowing it. There are many other ways someone can secretly record a private conversation or a room full of people, but people wearing devices on their head tend to make others nervous.

Another aspect that I think people are weary of, is whether or not these Glass wearers are really "present". Just like we frown at someone who is at our table but glued to their phone, are we going to have to face the issue of people looking to their upper right side reading texts, surfing the Web, etc. I'm not arguing that the screen Glass presents is more cumbersome of distracting than a phone. It is just more convenient and immediate.

The excessive use of technology has already taken so much attention away from everyday life as it used to be. Parents are distracted from their kids, from driving, and from work. Kids are distracted from each other, from school, and from their parents. These devices make it easier to get distracted from real human interaction. We're forgetting to enjoy the moment while photographing it.




Social Impact of Augmented Reality

The impact of technological immediacy has already impacted social behavior on a large scale. The growth of augmented reality devices will only increase that impact on our society. Just as social media brought the news we wanted to us when we wanted it, augmented reality will bring the very things in life we want at a much quicker way. AR devices will have access to many of things we already have access to but are less obvious, less cumbersome, and pose some security risks.

Hands free devices were a start. We were able to text and drive more safely than before. The addition of AR glasses and contact lenses made this even easier. Mapping a location, pulling up information about a person place or thing, and visualizing a change in a space will all be much more streamlined and second nature to us than ever before.

Much like many people do not remember actual phone numbers anymore because they are stored in their phones, will people start to rely on their AR devices to remember coworkers names, birthdays, etc.? To what extent will out lives become dependent on this immediacy of information and will people use it for good or bad?

How do AR devices make us better or worse people? For one, our privacy will be impacted greatly. Someone with AR glasses or lenses will be able to use facial recognition software and find someone possibly via social networks. Imagine if that person were a dangerous stalker. Would they know you were wealthy, where you lived, what places you frequented? These are important questions to ask ourselves when we think about the introduction of a technology many don't understand the extent of yet. Who will ensure that the right protection is implemented and that privacy laws are being followed?

I think people will become better liars. People will pull up information as they wish and use it for good and bad. Unfortunately many people are already suffering from social behavior issues and using technology in a negative way. That our personal lives can be unfolded to the wrong person is a scary thought.