Hardware Accelerator For Professional 3D Conversion (HA3D) | ASTRI - Hong Kong Applied Science And Technology Research Institute Company Limited

Project Title:

Hardware Accelerator for Professional 3D Conversion (HA3D)

Project Reference:

ART/174CP

Project Type:

Project Period:

20140409 - 20150908

Funds Approved (HK$’000):

10450

Project Coordinator:

Mr Yiu-kei Li

Deputy Project Coordinator:

Deliverable:

1. FPGA-based hardware accelerator for 3D conversion 2. Algorithms for depth estimation, view generation and output rendering 3. 3D conversion software plug-ins for commercial digital motion graphics and compositing software

Research Group:

Dr Keh-Chung Wang Mr Mark Mok Dr Yuzhong Jiao Mr Walter Chow Mr Teddy Wong Dr Man-Chi Chan Mr Ka-Leung Ho Mr Chan Fai Lam Ms Carina Huang Dr Chi Hong Chan Ms Rita Cheng Mr Yun Kau Lee Dr Luhong Liang Mr Gordon Chung Mr Kenneth Lo Mr Darcy Li Mr Tim Wong

Sponsor:

APW International Company Limited Marvel Digital Limited [Sponsor] Marvel Digital Limited (Technology Licensing) [Sponsor] VEFXi Corporation

Description:

For professional 3D content creation in the entertainment industry, 3D content captured by stereo cameras (or “native” 3D) is commonly deemed to be of the highest quality 3D content. However, shooting in 3D requires twice as many cameras, specialised rigs and specialised personnel as shooting in 2D requires and therefore, it is much more costly. Besides, lots of post-processing work is required for “native” 3D footage, which makes vast production of 3D contents in a short period of time difficult. A possible solution is converting 2D contents to 3D contents. However, a good conversion is typically labour intensive and time consuming. In this project, we will develop i) a hardware accelerator which will greatly reduce the 3D conversion time for professional 3D conversion; ii) a novel “invisible” depth format for content protection and prevention of resolution loss; iii) a feature to create an innovative 3D viewing experience with 2D/3D picture-in-picture and multiple 3D contents on a single display. The technology can be applied to conversion of films, commercials, and digital signage produced in 2D format into high quality 3D format. Our technology offers effective solutions for creating professional 3D content in the market.

Co-Applicant:

Keywords:

More about ASTRI

Hong Kong Applied Science and Technology Research Institute (ASTRI) was founded by the Government of the Hong Kong Special Administrative Region in 2000 with the mission of enhancing Hong Kong’s competitiveness through applied research. ASTRI’s core R&D competence in various areas is grouped under five Technology Divisions: Advanced Electronic Components and Systems; Artificial Intelligence and Trust Technologies; Communications Technologies; Innovative Mind; and IoT Sensing and AI Technologies. It is applied across six core areas which are Smart City, Financial Technologies, New Industrialisation and Intelligent Manufacturing, Digital Health, Application Specific Integrated Circuits and Metaverse.

Over the years, ASTRI has nurtured a pool of research, I&T talents and received numerous international awards for its pioneering innovations as well as outstanding business and community contributions. As of 2023/24, ASTRI has transferred more than 1,500 technologies to the industry and has been granted over 1,100 patents in the Mainland, the US, and other countries.

As a Hong Kong R&D centre, one of ASTRI’s important goals is to help customers harness business opportunities from the thriving technology market and increase their competitive strengths. Customers and partners can improve their efficacy by drawing on ASTRI’s expertise and research achievements.