2D 的使用者介面已經使用了超過30年，一直以來都沒有什麼大的變化，即使時至今日個人電腦的硬體運算能力越來越強，特別是圖像處理元件(GPU) 讓3D繪圖處理越來越有效率，人們使用平板電腦或者智慧型手機完成他們生活上大部份的應用，但是圖形使用者介面依然保留二維的特性，這某程度上是一種浪費。

如果想要建立一個3D可互動式的環境，必要再經過一大堆複雜的處理，以及各方面的技術。3D 可互動式環境的靈感來自於真實世界人們跟桌面上的物件互動的方法，我們希望可以讓人機互動也可以一樣的簡單。由於要從無到有建立一個3D 可互動式環境是非常複雜且需要很多的時間，因此我們提供應用程式介面(Application Programming Interface) 來簡化建立3D 可互動式環境的開發流程。
本文將會提出一個3D 可互動環境的概念並提供API(Application Programming Interface)以簡化開發3D 可互動環境的流程，最後會使用我們所提供的API 實作一個小DEMO 程式，證明我們的API 是可以使用的。

The 2D Graphic User Interface (GUI) have been used for 30 years. There are not any huge change. Even through the computing power of the hardware of personal computers (PCs) has become more and more powerful, especially the Graphic Process Unit (GPU), making the 3D Graphic Rendering more and more efficient and people using their tablet and smart phone to solve most of their problem, the GUI still keep its 2D feature. It is some kind of waste.

If developers want to build a 3D interactive environment from the ground to top, there must be a tons of work to do and problem to solve. The idea of 3D interactive environment was come from how people interact with the real world object. We hope we can make the human computer interaction as simple as the real world.

Since it is complicated and take a lot of time to build a 3D interactive environment, we provide an Application Programming Interface (API) to simplify the development.

In this paper, we propose the concept of 3D interactive environment and provide API to simplify the development and at last we implement a little demo program by using our API to prove our APIs are work

目錄
目錄	i
圖目錄	iii
表目錄	v
1. 緒論	1
2. 背景	7
2.1 Kinect	7
2.1.1 KinectSensor	8
2.1.2 ColorStream	9
2.1.3 DepthStream	10
2.1.4 SkeletonStream	11
2.2 Wii Remote	14
2.3 Bullet Physics Engine 跟 BulletSharp	16
2.4 DirectX, Direct3D and SharpDX	19
3. 系統描述	21
3.1 概念性架構(Conceptual Architecture)	21
3.2 系統架構(System Architecture)	23
3.2.1 輸入層(Input Layer)	24
Kinect:	24
Wii Remote:	25
3.2.2 資料分析層(Input data analysis layer)	25
3.2.3 事件處理層(Event Handle Layer)	29
3.2.4 核心層(Core Layer)	30
4. 系統實作	31
4.1 抽象化	31
4.1.1 對Kinect 與Kinect SDK 的封裝	31
4.1.2 對Wii Remote 的封裝	32
4.1.3 對於BulletSharp 的封裝	33
4.2 Demonstration	33
5. 結論與討論	36
5.1 結論	36
5.2 討論	36
6. 參考文獻	37
 
圖目錄
圖 1  3D 桌面美化工具	1
圖 2 地理資訊地圖系統的展示畫面	3
圖 3 擴增實境(AR) 環境的展示畫面	3
圖 4  Hands-Up system 的概念圖	4
圖5   (Hongyong & Youling, 2012) 的展示畫面	5
圖 6  Kinect感應器的內部設計	7
圖7 Kinect 深度資料格式示意圖	11
圖 8 Kinect 的骨架追踪的功能	12
圖9 Kinect 的骨架關節對應的位置	13
圖 11 Wii Remote 的正面與反面	14
圖12 Wii Remote 加速度計的座標系	16
圖13  BulletSharp 的DEMO 畫面	17
圖 14 本文提出的3D 可互動式環境的概念圖	21
圖 15  3D 可互動式環境的概念性架構	22
圖 16  3D 可互動式環境的系統架構	24
圖17a  (Dickinson, 2013)的演算法輔助說明	28
圖17b  (Dickinson, 2013)的演算法輔助說明	28
圖 18  Demo 的畫面截圖	34
圖19  Demo 實行把物件拿起來的動作的畫面截圖	35
圖 20 骨架顯示視窗	35

 
表目錄

表1  3D可互動式的環境 所需要的處理	6
表2 Kinect 的骨架關節的種類	13

6. 參考文獻
Catuhe, D. (2012). Programming with the kinect for windows software development kit O'Reilly Media, Inc.
Corbett-Davies, S., Green, R., & Clark, A. (2012). Physically interactive tabletop augmented reality using the kinect. Paper presented at the Proceedings of the 27th Conference on Image and Vision Computing New Zealand, 210-215. 
Dickinson, C. (2013). Learning game physics with bullet physics and OpenGL Packt Publishing Ltd.
Francese, R., Passero, I., & Tortora, G. (2012). Wiimote and kinect: Gestural user interfaces add a natural third dimension to HCI. Paper presented at the Proceedings of the International Working Conference on Advanced Visual Interfaces, 116-123. 
Hongyong, T., & Youling, Y. (2012). Finger tracking and gesture recognition with kinect. Paper presented at the Computer and Information Technology (CIT), 2012 IEEE 12th International Conference On, 214-218. 
Oh, J., Jung, Y., Cho, Y., Hahm, C., Sin, H., & Lee, J. (2012). Hands-up: Motion recognition using kinect and a ceiling to improve the convenience of human life. Paper presented at the CHI'12 Extended Abstracts on Human Factors in Computing Systems, 1655-1660. 
SharpDX.org. (2014). SharpDX. Retrieved, 2014, Retrieved from http://sharpdx.org
van Dantzich, M., Gorokhovsky, V., & Robertson, G. (1999). Application redirection: Hosting windows applications in 3D. Paper presented at the Proceedings of the 1999 Workshop on New Paradigms in Information Visualization and Manipulation in Conjunction with the Eighth ACM Internation Conference on Information and Knowledge Management, Kansas City, Missouri, USA. 87-91. doi:10.1145/331770.331791
Webb, J., & Ashley, J. (2012). Beginning kinect programming with the microsoft kinect SDK Apress.
Wikipedia. (2014a). DirectX. Retrieved, 2014, Retrieved from http://en.wikipedia.org/wiki/DirectX
Wikipedia. (2014b). Wii remote. Retrieved Retrieved from http://en.wikipedia.org/wiki/Wii_Remote