Artırılmış gerçeklik mobil uygulaması; İTÜ kampüs asistanı örneği

Abstract

Bu Yüksek Lisans tez çalışmasında artırılmış gerçeklik teknolojisinin navigasyon amacıyla kullanılması araştırılarak Istanbul Teknik Üniversitesi Maslak Kampüs asistanıoluşturulmasısağlanmıştır. Günümüzüngüncelveritabanları,konumalma yöntemleri, kullanıcıların tercih ettiği teknolojiler, proje yönetim, ve mobil uygulama geliştirme süreçleri araştırılarak mobil uygulamalarda artırılmış gerçeklik teknolojisi uygulanmış ve kullanıcıların kampüs içinde navigasyonunu kolaylaştırmak için Android mobil uygulama geliştirilmiştir.Çalışmada CAD (Computer Aided Design) ortamında oluşturulmuş olan 3 boyutlu İTÜ Maslak kampüs haritası işlenerek PostGIS veri tabanına dönüştürülmüş ve mobil uygulamalarla veri tabanı arasındaki bağlantıyı sağlamak amacıyla RESTful (Representational State Transfer) uygulama programlama arayüzleri kullanılmıştır.Mobil uygulamaların RESTful web arayüzlerini kullanarak çağrı yapması sonucunda etraftaki içeriği artırılmış olarak gösterebilmesi için Java Spring Framework'ünde sunucu uygulaması geliştirilmiştir. Uygulama programlama arayüzleri mobil uygulamalarla PostGIS veritabanı arasında yer alan ara katman olarak, kullanıcının mevcut konumuna göre gerekli içeriğin gösterilmesini sağlamıştır. Yapılan arayüz isteğine göre beklenen yanıtı alan mobil uygulamalar cihazın kamerasını sıfır noktası olarak belirleyerek coğrafi objeleri konumuna (enlem, boylam, yükseklik) göre onları kamera katmanı üzerinde artırılmış olarak listelemektedir.Çalışmada geliştirilen yazılımların takibi için en güncel teknolojiler araştırılarak JIRA proje yönetim aracı, Gradle versiyon yönetim sistemi, Git kod versiyon kontrol sistemi kullanılmıştır.Mobil uygulamada konum, kamera, dahili sensörler gibi yüksek performans gerektiren işlemlerin optimum çalışması için araştırma ve çalışmalar yapılmış, uygulamanın akıcı çalışması temin edilmiştir. Son olarak artırılmış gerçeklik kullanılarak İstanbul Teknik Üniversitesinin Maslak kampüs asistanı olan mobil uygulama geliştirilmiştir.

This thesis study created Istanbul Technical University Campus assistant by researching use of augmented reality for navigational purposes. By researching latest databases, mostly preferred technologies by uses, project management and mobile application development processes, augmented reality technology has been applied in mobile application and created Android mobile application to help users in navigation.Thesis study helped to process CAD based 3 dimensional ITU Maslak campus map, convert it to PostGIS database and to provide connection between database and mobile applications, to use RESTful application programming interfaces.Java Spring Framework used to develop server application with RESTful web interfaces to query necessary data from database and return it requesting mobile applications. Application Programming Interfaces take place as a gateway between mobile applications and PostGIS database to return response according to user's current location.Smart mobile phones, nowadays, can use satellite connections and much more technologies to retrieve location data of users with high accuracy. Any mobile phone starting the ITU Campus Assistant application, user location is being determined using GNSS (Global Navigation Satellite System). After the location is determined, the building names in this area are inquired by creating a buffer of a certain diameter circularly with the condition that the detected location data is considered to be the center. Once the data is queried, direction information is calculated using the sensors of the device to implement augmented reality, and information about the buildings is displayed on the camera of the smartphone.After receiving expected response from requested interface, mobile applications overlays geographical objects according to their locations (latitude, longitude, altitude) in the camera layer by accepting device camera as zero point.To trace software development status in the study, the latest technologies has been researched and JIRA project management tool, Gradle version management system, Git code version control system have been used.In the mobile application, research and studies have been carried out for the optimum operation, even though high-performance processes such as position, camera, internal sensors are used. In final stage, mobile application has been developed as a navigation assistant to Istanbul Technical University Maslak campus.The goal of the study is to create smart navigation within the ITU campus and to help current students or guests to find the places they are looking for without losing time.Augmented real-world technology, which is widely used today, has become a major field of use with the rapid expansion of mobile phones and mobile applications in parallel. The use of Bluetooth beacons, similar applications like Near Field Communication (NFC) technology, has been a source of inspiration for the work of this thesis. Our study aims to create an intelligent navigation course for students and guests within the ITU Maslak campus.The constant development of mobile phones and applications, and the fact that phones are hardware and performance have created a lot of needs and new generation applications today. Previously, mobile beacons connected to the museums or parks using Bluetooth beacons and NFC technology were used to inform the users and were preferred by the them. Augmented reality technology has also been developed along with the development of mobile phones and used together with location information.After a long duration of development, iOS 11 mobile operating system launched in September 2017, a new opportunity for Augmented Reality was available, and game development companies started to apply the new feature. After Apple released its ARKit software development tool on the IOS 11 mobile operating system, the number of new applications related to augmented reality in the Apple Store application market began to increase.Thesis is an example to the creation of a PostGIS database using 3D data in a CAD environment and implementation of RESTful application programming interfaces functioning as a gateway for exchanging data with mobile applications and the database. RESTful web services is descriebd in details in the section 4.3.2. Application Programming Interface. As a solution to the inability of mobile devices to obtain accurate location only with GNSS / GPS connection, during the study and research period, other location retrieving alternatives were also used to optimize users' location and crate augmented reality layer using inertial sensors.Since the application runs processes that require high performance, it has been worked on to support devices with low software performance, and necessary enhancements have been implemented for the fluent operation of the used user interface components. Apart from this, SSL (Secure Sockets Layer) pinning technology has been applied for the security between applications with RESTful interfaces and an interface layer has been created for the security of the user data that the navigation assistant receives. Created SSL layer is explained in details in section 4.3.3. Development of mobile applications.Modern researches related to Augmented Reality is explained in details in Section 2 and required inertial sensors for tracking objects are described with the camera movements after the virtual objects are placed in the physical environment.The study summarizes the methodologies of location data retrieval and processes by operating systems. The methodologies used to retrieve the location data detailed in Chapter 3 are taken in Android and IOS core operating systems, and facilitate the software engineers who develop mobile applications, while maintaining the data privacy of smartphone users.The processing of the necessary data related to the augmented reality and the implementation of process, from its software to its follow-up are described in Chapter 4. Implementation of current technology and standards in today's mobile application software process and follow up of the latest technologies in the management of this process has set an example for future software applications.Today, there are open-source interfaces from organizations like Wikipedia, Twitter, OpenStreetMap, and they give availablity to query nearyby geographic objects based on the location of the requesting user. In our study, additionally, we have built an infrastructure that can be dynamically managed and aim to work as a part of the software which is a mobile software development kit, in the future.Application development interfaces are designed for geographic information data exchange without being deliberately restricted. This aims to contribute to the creation of an enhanced augmented mobile application by ensuring that future work will be used as a software development kit, with little application development knowledge.