Wave optic modeling of semi-transparent textured curved surfaces

Lightwave propagation through a multilayer structure of patterned semitransparent curved surfaces is a fundamental issue for various display applications from practical industrial problems such as moiré pattern strain in touch panel displays to fundamental research issues in layered tensor displays and layered complex modulation holographic displays. In this paper, a wave optic modeling of multiple layers of patterned semi-transparent curved surfaces is presented. The proposed wave optic modeling is based on the algorithmic framework used in the field of polygon computer-generated holograms, a framework which can additionally devise the characteristic transmittance function of textured curved surfaces. To present an industrial application, the proposed modeling method is used to numerically simulate the visual perception of the moiré patterns observed in the layered structures of transparent phase-only patterned curved surfaces and their diverse variations with a change in observation angle. © 2018 Optical Society of America under the terms of the OSA Open Access Publishing Agreement


Introduction
As highly consumer-oriented functionality is integrated into displays, state of the art display architecture is becoming increasingly functionally versatile through the incorporation of an increasing number of functional layers [1].The combination of a flexible touch-screen functional layer and a high-resolution curved or flexible display panel is one such example, which has become a mega-trend in industrial display technology.Such combinations of optical layered surface structures are found in numerous optical applications such as touch panel displays, parallax barrier displays, lenticular displays, integral imaging displays, multilayer tensor displays, and holographic displays [2][3][4].Diffractive or holographic patterns on curved surfaces are promising advanced display applications [5].However, the optical attachment of two different optical surface layers induces various optical and visual effects [6], in which some of them are desired but the others are unwanted in a practical point of view.
Display optics should cover not only the optical system of the display but also the viewer's eye, and, from this perspective, a theoretical analysis of the visual perception of layered patterned curved surfaces is fundamental and widely applicable [7].Furthermore, approaches to analyzing visual perception need to consider issues of wave optics beyond the scope of the conventional geometric optics normally applied in display optics analysis.For instance, moiré effects in the display field are an issue particularly associated with this context.These patterns are observed by sensitive viewers, in which the diffraction induced by the pixel structure of the display panel and the externally attached optical patterns optically interact.Transparent patterns, that is, phase-only patterns can also generate visual moiré patterns on interaction with periodic patterns of display panel [8].In particular, this type of moiré cannot be interpreted by conventional geometric optical analysis.
Therefore, in this paper, we develop wave optic modeling of semi-transparent textured curved surfaces.The proposed method is based on wave optic theory, particularly the polygon computer-generated hologram (CGH) theory [9].According to this theoretical framework, situations in which a viewer observes a curved surface can be analyzed as if the viewer is looking upon a meshed surface composed of triangular facets.The computational wave optic model is constructed for light field transmission through a generally curved surface layer structure with semi-transparent transmittance characteristics and its visual perception.The model focuses on the visual perception of a viewer's observation, i.e. the light field distribution on the viewer's retina plane.This paper is organized as follows.In section 2, the wave optic model of the light field generated by layered surfaces featuring characteristic surface transmittance functions is described.In section 3, the results of the simulation of the visual perception of various curved moiré patterns are presented.In section 4, concluding remarks are given.

Wave optic modeling of optical curved surfaces represented by connected textured polygons
In this section, first, the fundamental wave optic model of an optical curved surface represented by a connected textured triangular polygon is developed.Figure 1 schematically illustrates the model of a viewer's eye watching a triangular facet.Without loss of generality, it is assumed that the eye is on the z-axis, that is, the line of sight is matched to the z-axis.In Fig. 1, the geometric imaging transformation of the human eye is illustrated, where the triangular facet 1 2 3 P P P in the object space is mapped as the triangular facet 1 2 3 r r r P P P of retina space of the viewer's eye.For the three apex points of the triangular facet, ( ) , , x y z and ( ) , , x y z , the apex points of the imaged triangular facet are obtained, respectively, by ( ) , , r r r x y z , and ( ) x y z .The center of mass of the triangular facet and the focal length of the eye lens are set to ( ) x y z and f , which is given by ( ) x y z denote the center of mass of the triangle 1 2 3 r r r P P P in retina space corresponding to the center ( ) x y z in object space and then the imaging point of an apex point ( ) , , x y z of the object space triangular facet is given by ( ) ( ) , , / , / ,  Each triangular facet is supposed to be dressed by its own texture.The texture image is transported to retina space by the geometric imaging transformation, which is expressed based on the collinear condition.In Fig. 1, the line connecting the object point ( ) , , x y z and the projection center ( ) 1 0, 0, d is collinear to the line of ( ) , , x y z and the mapping point ( ) x y z , and the relationship is expressed by ( ) where the parameter t is obtained as, by substituting Eq. (1) into the plane wave equation, ( Next, let the local coordinate systems of the triangle facets 1 2 3 P P P and 1 2 3 r r r P P P be ( ) . Each triangular facet has its own local coordinate system with the origin set to its center of mass.The local coordinate of a point in object space is solved for the global coordinate cos cos cos sin sin sin cos 0 , sin cos sin sin cos where θ and φ are the longitudinal and azimuthal angles denoted in the object space of Fig.
1 x' where r θ and r φ are the longitudinal and azimuthal angles denoted in retina space of Fig. 1.
The geometric mapping between the local coordinate points ( ) x y z ′ ′ ′ reads as ( ) cos cos cos sin sin 0 sin cos 0 0 , sin cos sin sin cos where t is given by Eq. ( 2) and ( ) x y z is solved by the inversion of Eq. ( 4) as cos cos sin cos sin sin cos cos sin sin .
The above geometric transport mapping interprets the point ( ) ′ ′ on the surface of the facet by a function of ( ) x y ′ ′ with the equation of a plane, ( ) . Therefore, given a texture pattern on the triangular facet, the transported texture pattern is numerically obtained using the mappings ( x y x x y y x y ′ ′ ′ ′ ′ ′ ′ ′ = and, its inverse mapping, ( In polygon CGH theory [9], the textured light pattern is represented in global retina coordinate system by where the angular spectrum of the retina global field, ( ) H ' e Based on the above theory, we simulated a color textured curved surface consisting of polygons [10].The polygon model of the curved surface consists of 24 polygon facets and is shown in Fig. 2, in which it is located 1m from a viewer in free space.By applying the polygon model, we obtained the mapped texture on the curved surface in the local retina coordinate system [11] and calculated the optical field distribution using Eqs.(7) and (8).When calculating the textured polygon surface, we employed the fast Fourier transform (FFT).Although some theoretical research has attempted to realize the analytic calculation of holographic fields of textured polygon surfaces [12], its applicability to generalized texture patterns remains limited.The texture example that is shown in Fig. 2(a) is a periodic pattern of three RGB lines.In this simulation result, we found the dark line-defects contaminating surface texture at the borders between adjacent triangular facets in the polygon connected surface as indicated in Fig. 2(b).As an initial approach to the line-defect problem, we first analyze a simpler non-textured curved surface that consists of 8 bare triangular facets.The curved surface is supposed to be located 30cm from the viewer as shown in Fig. 3(a) and the observed image by the viewer's eye that is imaged on the retina plane is calculated.Figure 3(b) presents the resulting numerical simulation result, wherein some line defects are apparent at the bordering lines between neighboring polygon facets.It is well known that when the angular spectrum of the phase-matched triangle polygon is calculated by the analytic method [10,13], line defects can be removed effectively.The advanced analytic formula for arbitrarily textured triangular facets has not been developed and remains a challenging problem.
Thus the present analytic angular spectrum method is very limited when expressing the general textures of polygon facets.Therefore, for general textured objects, the use of FFT is both popular and inevitable.However, a problem arises when using FFT to calculate general textured triangular facets.When applying the phase-regularization technique to FFT polygon calculations, the technique does not work as is presented in Figs.2(a) and 3(b).The discrete approximation of the continuous angular spectrum integral taken in FFT polygon calculations induces numerical errors that lead to the line defect problem.
The tilted triangular facet has a characteristic shape of three-lines along the direction perpendicular to the corresponding side of the triangle as illustrated in Fig. 3(c) [14].When the triangle facet is tilted in space, the branch of the angular spectrum forms distorted curvy lines.Steps 1, 2 and Steps (1 + 2) in Fig. 3(c) presents the case of the calculation of a simple polygon surface composed of two triangular facets connected by a shared edge.The angular spectrum branches of the edges of the left triangle, 1 L , 2 L , and 3 L are denoted by 1 A , 2 A , and 3 A , respectively, while in Step2 those of the right triangle, 4 L , 5 L , and 6 L , are denoted by 4 A , 5 A , and 6 A .In the analytic method, the angular spectrums of the shared edges are exactly removed in Step1 + Step2 which is mathematically expressed by 4 0, A A + = (10) meaning that the two shared edges represented by 2 L and 4 L precisely cancels each other out and the line artifact does not develop, as was proven in previous research [10,13].However, in the FFT calculation, the angular spectrums of the shared edges do not precisely cancel each other out because of the considerable numerical errors induced by the discrete approximation of FFT, which causes the non-zero line artifact at the border of the two adjacent polygons.This non-cancelation process of the shared edges 2 L and 4 L is expressed in terms of the angular spectrum as follows: where the numerical noises of the angular spectrums 2 A and 4 A are denoted by 2 ε and 4 ε .
In practice, for most industrial applications including wave optic analysis of curved or flat surfaces, those kinds of line artifacts are unacceptable.Therefore, a method for the removal of the FFT-induced line artifacts is necessary.As a solution, we propose a technique that partially filters the angular spectrum.The filtering principle and the practical process are presented in Fig. 4(a).In the first setup, the shared edges of the unit polygons of a given polygon mesh surface are identified.In the second step, the branches of the partial angular spectrums of the shared edge parts are selected and extracted.For arbitrary spatially tilted triangular facets, we can deterministically trace their angular spectrum branches in an analytic manner based on our previous work [14].Finally, in the third step, the selected branch of the angular spectrum that represents the shared edges in the spatial domain is removed.It is essential to note that, during the filtering process, the remaining part of the low-frequency signal is of importance because the low-frequency signal contains the essential part of a texture pattern.A numerical example of the proposed partial filtering process for a single polygon of the target object is presented in Fig. 4(b).Figure 4(b) presents the filtered angular spectrum and Fig. 4(c) compares observed images featuring line artifacts produced by the conventional method to the one featuring much-reduced line artifacts produced by the proposed method.As another example, for the R/G/B line textured curved surface, we apply the filtering process to all polygons and calculate the observed image of the curved surface with line defect removal.The proposed filtering process presented in Fig. 4

Layered optical surfaces with a characteristic surface transmittance function
The wave optic modeling of curved surfaces developed in the previous section is extended into a model of semi-transparent textured curved surfaces.It is used to analyze the visual perception of the moiré patterns observed in most layered structures that are comprised of transparent patterned curved surfaces and to analyze the diverse variation of those patterns with changes in observation angle.In practice, electrode patterned transparent touch panel sheets can be interpreted as phase-only modulation surfaces.In general, the moiré pattern appears when two or more curved surface layers possessing amplitude periodic modulation patterns overlap.However, the following simulation shows that moiré patterns can also be generated strongly by transparent sheets possessing transparent periodic phase-modulation patterns such as those normally engraved on transparent electrode sheets.If the surfaces or sheets are transparent or semi-transparent and feature phase modulation characteristics, the wave optic model should be applied carefully since such transparent sheets are not affectively analyzed by the geometric optics method popularly applied by the industry.Figure 6(a) illustrates the situation of the observation of a double layer of amplitude modulated curved surfaces separated by a finite distance.The viewer can see a moiré pattern through the layered surface.The wave optic analysis algorithm for this typical structure is schematically described in Fig. 6(a) and the moiré pattern simulation results are presented in Figs.6(b)-6(d), in which the variation of the moiré pattern with respect to change in the viewer's focus is simulated.According to the proposed analysis scheme, an algorithm for calculating the optical field of a moiré pattern in the retina plane of the viewer is devised, where the patterns of the front and rear curved surfaces are denoted by ( ) The corresponding optical fields at the retina plane are denoted by ( ) respectively.In this schematic, the forward wave propagation from the object space to the retina plane of the viewer and the backward wave propagation from the retina plane to the object space are complementarily described by the pair of the cascaded Fresnel transform (CdFr) and the inverse cascaded Fresnel transform (ICdFr), respectively [14,15].The cascaded Fresnel transform pair is an essential theoretical part in the wave optic modeling of

Conventional method
Proposed method (a) (b) In Fig. 7, the situation that a viewer sees a curved surface with a moiré pattern generated by crossed tilted periodic patterns from several directions is addressed.It is assumed that the viewer does actually see the curved surface, but that the perceived moiré patterns vary in accordance with the observation direction.The observation angle is changed from 6° to 24° along the longitudinal direction as shown in Fig. 7(b).The simulation results show that the curvature of the curved surface is more noticeable and that the moiré pattern changes as the viewing angle increases.Figure 7(c) shows the accommodation effect of the moiré pattern at the different focus of the viewer.When the viewer focus is at 1.98m (the front panel), a clear moiré pattern is obtained.On the other hand, blurred moiré patterns are observed when the viewer focus at 0.5m and 0.2m from the eye in the free space with vertical color bands developing around the left and right edges of the surfaces.In Fig. 8, the effect of the proposed line defect filtering is tested in the curved surface moiré simulation.As similar as shown in Fig. 5, the moiré pattern simulated by the conventional method without a filtering process present line defects crossing the curved panel, while the filtering of line defect on the curved surface works effectively to remove the line defects in the simulated moiré pattern.Since, in industrial application, this type of non-physical artificial numerical defects are not accepted, we need to take care of modeling of curved surfaces with a line defect filtering as described in this paper.
Figure 9 presents an industrial application which may produce a complicated moiré pattern.The moiré patterns produced by a bottom layer of a flexible organic light emitting diode (OLED) display and an upper flexible touch screen panel (TSP) is investigated.In this case, the ITO electrode of the touch panel screen is visually transparent, so the conventional geometric optical analysis is not applicable and only the wave optic analysis should be The specification of the typical PenTile pixel pattern of OLED displays and ITO pattern of TSP are presented in Figs.9(a) and 9(b), respectively.The red, green, and blue wavelengths of the RGB OLED are set to 632nm, 532nm, and 473nm, respectively.In this simulation, the thickness and refractive index of the ITO pattern on the TSP are assumed to be 50nm and 1.9, respectively.In order to calculate the moiré pattern of 33cm by 22cm, the simulation resolution of 50001 × 50001 is necessary, which means that the light field variables in this analysis such as 1 F , 2 F , 1 u , and 2 u are 50001 × 50001 complex matrices.The resultant moiré pattern of the layered structure, only with the green pixels turned on, is shown in Fig. 9(c).The periodic stripe moiré patterns in vertical direction caused by layered structure are observed in Fig. 9(c).Sometimes we found that the shape of the moiré pattern simulation result can be observed differently on different monitors during the simulation.If the resolution of the picture is larger than the resolution of the monitor, the computer may distort the moiré by interpolating of deleting the image data according to the picture size displayed on the monitor.In the simulation result, moiré pattern can be decomposed into lowfrequency and high-frequency parts.At this point, low-frequency part of the moiré pattern delivers a visible stripe pattern which deteriorates the display image quality.However, in general, the removal of this type of moiré pattern is difficult in practical industrial display applications since this annoying moiré pattern is very sensitive to small mismatch in panel alignment.

Concluding remarks
We have presented the theoretical framework of a layered or overlapped curved surface with a surface texture pattern representing amplitude or phase transmittance functions.The numerical analysis method was applied to simulate complicated moiré patterns on layered curved surfaces and the industrial problem of the moiré patterns expected of flexible OLED displays with TSP panels.The numerical analysis of the moiré patterns in industrial applications have been developed in this paper, but the technical removal of the moiré patterns is a difficult problem to necessitate extended research.The proposed model can be useful for this more practical research for this problem.Furthermore, the proposed model is extensively applicable to the image quality analysis of general multiple layered displays such as liquid crystal displays with TSP, holographic three-dimensional display, and tensor displays as well as flexible OLEDs with TSP.

Funding
Samsung Display Co. Ltd.
define two planes in object and retina spaces, respectively,
. The local coordinate of the corresponding point in retina space is given by define the characteristic transmittance function on retina local domain by ( ) , r r T x y ′ ′ and represent it by the angular spectrum integral of the local coordinate system as

Fig. 2 .
Fig. 2. (a) Simulation of color textured curved surface with a line-defect and (b) its polygon facet model.

Fig. 3 .
Fig. 3. (a) Simulation schematic of a simple polygon surface, (b) observation of non-textured simple polygon surface with line defects, (c) intuitive analysis of the cause of line defect generation and a comparison of (d) the analytic calculation and (e) the FFT-based calculation

Fig. 4 .
Fig. 4. (a) Filtering process of the angular spectrum with line defects and (b) its simulation.(c) A comparison of the conventional and proposed methods.

Fig. 5 .
Fig. 5. Full-color simulation results by (a) the conventional method and (b) the proposed method.
Longitudinal angle = 18°Longitudinal angle = 24°Focus at 0.2m (free space) Longitudinal angle = 6°Longitudinal angle = 12°Focus at 1.98m (front panel) Focus at 0.5m (free space) a) Two curved surfaces which are integrated into the object space are observed at various observation angles.(b) Color moiré simulation results for various observation angles and (c) variation in the accommodation effect with a change of focus.

Fig. 8 .
Fig. 8. Moiré patterns of two curved surfaces calculated by (a) the conventional method and (b) the proposed method.The line defects perceived in the simulation result of the conventional non-filtering method is removed from that by the proposed method.

Fig. 9 .
Fig. 9. Industrial example: (a) 1543X1896 periodic patterns of OLED pixels and (b) 4714X1811 periodic patterns of ITO patterns are used in this example.(c) The moiré pattern formed by the layered OLED pixel and ITO structure.It is assumed in this simulation that the green pixels of the OLED pixel is turned on and the other colors are turned off.The OLED pixel pattern of 162μm 174μm × and the ITO pattern of 138μm 70μm × are supposed to cover a slightly curved rectangular surface area of 33cm × 22cm by a form of a periodic pattern.The OLED pixel pattern and the ITO pattern are represented by ( ) 2 , , u x y z