Future HCI with the impact of generative AI

The Evolution of Human-Computer Interaction(HCI): From Command Lines to Conversational Interfaces

The story of human-computer interaction (HCI) is one of constant evolution, marked by humanity's quest to make digital technology more accessible, intuitive, and aligned with our natural behaviors. This journey has witnessed several paradigm shifts, reflecting the broader technological trends and societal needs of their times.

The Dawn of HCI: Command-Line Interfaces

The early days of computing were dominated by command-line interfaces (CLI), which required users to interact with computers through a series of typed commands. This form of interaction demanded a steep learning curve and a strong understanding of specific command languages, inherently limiting the user base to those with technical expertise.

The GUI Revolution: Widening Accessibility

The introduction of graphical user interfaces (GUI) in the 1980s marked a significant leap forward. Pioneered by companies like Xerox, Apple, and Microsoft, GUIs replaced text-heavy commands with visual icons and menus, making computers more user-friendly and vastly expanding their appeal to the general public.

The Rise of the Internet: Browsers and Search Engines

With the advent of the internet, browsers and search engines became the new frontiers of HCI, allowing users to navigate the vast web of information through hyperlinks and search queries. This era cemented the "query-response" model of HCI, where users input queries and the system provides the best possible results based on algorithms.

Mobile and Touch: The Gesture-Based Interaction

The proliferation of smartphones and tablets introduced touch as the new mode of interaction, with swipes, taps, and pinches becoming second nature. This period saw HCI become more intimate and direct, as devices became extensions of the human body.

Voice Assistants and Conversational UIs: Speaking Naturally

The emergence of voice assistants and conversational interfaces further humanized HCI, enabling people to interact with technology through spoken language. This shift is characterized by the development of AI-driven technologies like Siri, Alexa, and Google Assistant, which can interpret and act on voice commands, making technology even more seamlessly integrated into daily life.

Toward Intuitive and Generative Interactions

Now, we stand on the brink of another significant transition, driven by generative AI and AR. As AI becomes more generative and anticipatory, it is shifting from reactive systems that wait for user input, to proactive systems that offer a multitude of possibilities before a user even makes a specific request.

From Tool Use to Partnership

We are moving beyond the concept of computers as tools and towards the idea of them as partners in the creative process. The HCI of tomorrow is not just about issuing commands and receiving outputs, but about engaging in a dialogue with technology, where it understands not just the literal meaning of our words, but the intent and emotion behind them.

The Immersive Turn with AR

Augmented reality is transforming HCI by overlaying digital information onto the physical world, creating a seamless blend of real and virtual that opens up new dimensions for interaction and experience.

Looking Back to Look Forward

By reflecting on the history of HCI, we can appreciate the magnitude of the shift that lies ahead. Each era of HCI brought technology closer to the natural human modes of interaction—from text, to touch, to voice, and now, towards a blend of intuition, creativity, and reality augmentation.

The development of HCI has been a tale of increasing sophistication and personalization. As we research and shape the next chapter with generative AI and AR, we're not just creating new interfaces; we're crafting experiences that resonate more deeply with the human psyche and enable a more profound human-technology symbiosis.

My Research Interests

“Human ingenuity propels technology forward, while technology redefines the landscape of human-computer interaction.”

HCI & Generative AI

Generative AI is rapidly transitioning from a tool that creates content upon request to an intelligent partner capable of enhancing human creativity. Future software equipped with generative AI will not merely serve content but will anticipate needs and craft responses in ways that feel more human, more engaging, and surprisingly inventive.

Towards a Synergetic Relationship

The core of my research revolves around the changing dynamics between humans and software. Rather than acting as passive recipients of information, users could co-create with AI, iterating on their ideas in real-time and watching as AI instantly generates multiple representations of those ideas. This collaborative form of HCI could significantly accelerate innovation in fields such as graphic design, architecture, and beyond.

Creative Cohesion and Ethical Considerations

As we chart these new territories, the ethical dimensions of generative AI in HCI cannot be overstated. I am interested in exploring how we can maintain creative ownership, ensure responsible use, and prevent the misuse of such potent technology, all while fostering an environment that encourages creative exploration.

Generative AI & Augmented Reality

My second area of research fascination is the intersection of generative AI with AR technology to create customizable virtual environments for individuals. This combination has the potential to revolutionize not just entertainment and gaming, but also to have profound impacts on various societal aspects.

Mental Health Therapy

In therapeutic settings, AR-generated environments can be tailored to patients' therapeutic needs, providing a safe space for exposure therapy, or crafting serene landscapes for meditation and stress relief. The integration of generative AI could personalize scenarios based on a user's response to treatment, making mental health care more accessible and effective.

Education and Learning

In education, AR can bring learning to life, creating interactive, customizable experiences that adapt to a student's learning pace and style. Generative AI could contribute by creating dynamic content that reflects students' curiosities, thereby enhancing engagement and retention.

Accessibility for Disabilities

For individuals with disabilities, AR combined with generative AI can break down barriers by creating environments tailored to their needs and preferences. Whether it's translating text to speech in real-time or generating virtual sign language interpreters, the applications are vast and varied.

Professional Training

In professional spheres like medicine or aviation, AR simulations, powered by generative AI prompts, can provide hyper-realistic training scenarios. These could adapt to the learner's skill level and modify in real-time to present various challenges, preparing them for real-world situations more effectively.

Urban Planning and Environment

Urban planners could leverage these technologies to visualize and simulate changes to landscapes, infrastructure, and even predict the environmental impact of potential decisions. Such tools could engage community members in the urban design process, fostering a more democratic and inclusive approach to city planning.

Cultural Preservation

AR can be used to reconstruct historical sites or lost cultural heritage, offering an interactive educational tool that preserves the past. Generative AI can add to this by recreating historical events or simulating ancient civilizations, allowing users to experience history first-hand.



Reference paper:

GenAICHI 2023: Generative AI and HCI at CHI 2023 https://dl.acm.org/doi/10.1145/3544549.3573794

https://generativeaiandhci.github.io/

Combating Misinformation in the Era of Generative AI Models https://dl.acm.org/doi/10.1145/3581783.3612704

GenAIR: Exploring Design Factor of Employing Generative AI for Augmented Reality https://dl.acm.org/doi/10.1145/3607822.3618018

This article was brought to life with the assistance of ChatGPT, my AI collaborator, whose insights and generative capabilities helped shape the narrative and enrich the content. A testament to the very subject at hand, this partnership between human thought and artificial intelligence showcases the potential of what we can achieve when we blend the creativity of the human mind with the computational power of AI.

Previous
Previous

3 Papers I Wish I'd Written

Next
Next

AR Learning Path and Challenges