At first glance, the contraption looks like your average drone: frame, motor, battery, propellers. Truth be told, without the minds of a 性视界传媒 team dreaming something greater for it, the drone is average.
But this drone is a member of the Flying Orchestra. Like the Bellagio鈥檚 fountain show, the Flying Orchestra promises to revolutionize entertainment by combining two 鈥渕edia鈥 that traditionally stood apart. Instead of music and water, in this case, the Flying Orchestra synchronizes music and flight.
For engineering professor Si Jung 鈥淪J鈥 Kim and undergraduate researcher Martin Jaime-Viveros, research work on the Flying Orchestra has swiftly transformed to play. The drone and its siblings will one day rock the sky, dancing in choreographed patterns to any music our hearts desire.
The Flying Orchestra鈥檚 origin seems serendipitous and inevitable at the same time. When Kim arrived at 性视界传媒 in 2014, he noticed that Nevada was one of only seven U.S. states focusing on drone research. Wanting to differentiate himself from others in his field, Kim drew from Vegas鈥 entertainment staple 鈥 shows 鈥 and created the drone troupe, which brought Vegas flair to his engineering background.
Jaime-Viveros had been dabbling in bioinformatics, robotics, and embedded systems labs on campus when the opportunity to join Kim鈥檚 project presented itself. It would prove to help him chart a course not only for drones, but also his future.
Kim: One of my jobs at 性视界传媒 is recruiting students to engage in research. At the time, (fellow engineering professor) Venki Muthukumar was my neighbor in the Science and Engineering Building, and whenever we鈥檇 meet on the floor in the hallway, we鈥檇 chat. I told him I was looking for a highly motivated and creative student to work on my Flying Orchestra project, and he mentioned Martin.
Jaime-Viveros: I鈥檇 worked in a few different labs before, and as I gained experience, I realized I wanted to get involved in artificial intelligence. Dr. Muthukumar introduced me to Dr. Kim, and in talking to him and learning more about the Flying Orchestra project, I wanted to get involved.
Kim: When Martin told me about the Java script and drone work he鈥檇 done, I had no further questions. I knew he鈥檇 be a good fit in my lab.
So began the journey toward transforming drones into dance machines. Jaime-Viveros jumped right into building out the orchestra alongside engineering professor Peter Stubberud, co-principal investigator on the project; researcher Paolo Ginobbi; and fellow students Brandon Navarro-Ontiver and Su Jin Park.
The team explored different drone models together and ultimately selected an augmented reality model from France. Jaime-Viveros developed a functional block diagram visualizing all the program modules necessary to send and receive data as well as the electrical components the team would have to develop.
Where to best place the modem that assigns IP addresses to each drone, thereby enabling multiple drones to be controlled as an individual unit, would prove challenging. But Kim鈥檚 lab is a safe place where conventions are challenged and students learn through their own trial and error. It鈥檚 the kind of space that allowed Jaime-Viveros to develop a simple yet effective method for controlling the drones without an orientation.
Kim: Here鈥檚 my philosophy on interacting with students: I have to give them an opportunity to learn for themselves first. Whenever there鈥檚 something we need to design and develop, I ask them if they think they can do the task themselves first. If they say yes, then I give them the opportunity to try. If they say no, I give them a concept so they can figure out a way to conduct their work. Then, we meet, and I provide feedback on their trials.
Jaime-Viveros: I came in with skills I鈥檇 learned in class and experience I gained in previous labs, but the training I鈥檝e received here is mentoring. I鈥檝e been able to gain new perspectives that have changed my attitudes, caused me to be skeptical about the results we generated, and pushed me to ask the right questions that enable that skepticism. For example, when we tell a drone to go straight, whether it goes straight or not, we can ask why it did what it did and verify that.
Kim: My team members are very expressive and challenging. That鈥檚 part of how they contribute to the project, and without that, there鈥檚 no way the project can be successful. I learn from them all the time.
Jaime-Viveros: We鈥檙e able to argue with each other constructively. We often disagree about our approaches, but we always manage to compromise or persuade each other and keep the project improving and moving forward.
Kim: All the students on this project play important roles, like a gear mechanism. Without one gear, the whole project can鈥檛 move forward, which means I need to trust my students and actually rely on these team members. And I do.
Kim couples his technical lessons for student researchers with professional skill building. Kim uses the 鈥減roject deferment process鈥 to develop student organizational skills and patience. He asks them to step back from building, take a bird鈥檚-eye view of the project, and design before rushing forward with implementation.
These soft skills that Jaime-Viveros was picking up in the lab would prove useful in his dealings with outside organizations and vendors. Ordering and setting up IP sensors on the drones required effective communication, negotiation, and collaboration鈥攁ll areas in which Jaime-Viveros now excels, Kim noted.
Jaime-Viveros: Communicating with vendors and dealing with technical support was very new to me. It was a little nerve-racking at first when I had to contact a really experienced engineer on the outside who doesn鈥檛 know me. I didn鈥檛 know how he was going to react when I had to explain things to him that he was an expert in. But I learned how to deal with people better. Engineering is not just about solving problems with yourself. From what I鈥檝e seen, it鈥檚 mostly about solving problems with other people.
Kim: Students on this project are very creative, and that creativity always manages to bring in ideas that help us solve problems and overcome any challenges or difficulties, both in and outside of the lab.
One difficulty that usually arises for every researcher at some point is the financial kind. Jaime-Viveros is grateful for the hourly wage he receives at Kim鈥檚 lab, a place he spends roughly 20 hours in each week independent of his credit hours.
Jaime-Viveros recalls that, earlier in his academic career, when he worked off campus doing carpentry or washing cars, he felt more disconnected from his undergraduate experience. He鈥檇 come to class, leave to work, and go home in the evenings exhausted.
At a certain point, he noticed he was keeping up academically but falling behind his peers professionally. Some of his fellow students had landed internships or were working on personal projects on campus to build their resumes, getting ahead outside of class in ways that would undoubtedly impact their careers for the better. If they could land these gigs on campus, why couldn鈥檛 he?
The lab is now Jaime-Viveros鈥 second home. Even when he鈥檚 not working on the Flying Orchestra, you can often find him there, wrapping up his regular schoolwork or just taking a breather.
He now has a better understanding of the job market he鈥檒l enter as well as what it鈥檚 like to work in his field. His next step after graduation: to obtain a graduate degree in computer science right here at 性视界传媒, continuing his work on the Flying Orchestra.
Kim: We have big plans for this Flying Orchestra research. My immediate goal is to finish this project and sell it to one of the hotels on the Strip. After that, I鈥檇 like to propose another project synchronizing multiple drones outdoors. All this means I want to continue on, hopefully with Martin and other students interested in the project as their dissertation focus.
Jaime-Viveros: This has been a big learning experience for me. In addition to the technical skills, I realized that I love working with people as a team, directing other students, and being directed by my mentors. The flying orchestra we鈥檙e creating together will be a dynamic instrument to create a new kind of art with robots and music. It鈥檚 incredible.
