• 专利附录
  • 专利说明
  • 权利要求
  • 类似技术
  • 同族专利
  • 引用文献
  • 法律状态
  • 优先权
    • 专利摘要:
    The invention relates to a method of digital photogrammetry for measuring a part of the human body, preferably a foot, or a hand or a neck, without 3D reconstruction of said body part. In particular, the invention makes it possible to determine characteristic dimensions of a foot from digital images, with a view to their use for the custom-made manufacture of shoes. The photographs are advantageously taken using a smart phone with a camera, by the person himself, according to a simple shooting procedure.
    公开号:FR3060735A1
    申请号:FR1662478
    申请日:2016-12-15
    公开日:2018-06-22
    发明作者:Maxime MOREAUD；Franck Le Franc；Sophie Engster；Frederic Itthirad
    申请人:Chamberlan；IFP Energies Nouvelles IFPEN；
    IPC主号:
    专利说明:

    Holder (s): IFP ENERGIES NOUVELLES Public establishment, CHAMBERLAN Simplified joint-stock company.
    Extension request (s)
    Agent (s): IFP ENERGIES NOUVELLES.
    FR 3 060 735 - A1 (541 METHOD FOR MEASURING A PART OF THE BODY FROM DIGITAL PHOTOGRAPHS, AND IMPLEMENTING SUCH A METHOD FOR THE MANUFACTURE OF CUSTOM SHOES.
    ©) - The invention relates to a digital photogrammetry method for measuring a part of the human body, preferably a foot, or even a hand or a neck, without 3D reconstruction of said part of the body. In particular, the invention makes it possible to determine characteristic dimensions of a foot from digital images, with a view to their use for the custom manufacture of shoes. The photographs are advantageously taken using a smart phone having a camera, by the person himself, according to a simple shooting procedure.


    Field of the invention
    The present invention relates to the field of measurement from digital photographs, also called photogrammetry, in particular the measurement of a part of the human body, and more specifically the measurement of a foot. The invention is advantageously used in the context of the manufacture of custom-made shoes.
    General context and objectives of the invention
    There are known methods of measuring from digital images of an object, in particular of the human body, using complex image processing procedures aimed at providing a three-dimensional (3D) reconstruction of the object.
    Many methods of 3D reconstruction of an object from digital photographs exist, some of which are based on the use of a calibration target for the sensor calibration step, and on the processing of several images of the object. for the reconstruction of it in space.
    The present invention provides a simple and robust method for measuring a part of the body, such as a foot, a hand or a neck, from digital photographs, without requiring a 3D reconstruction of said part of the body. The proposed method can advantageously be implemented by the person himself who wishes to measure a part of his body, without a dedicated image taking device, that is to say for example by means of a simple smart phone. incorporating a camera.
    The present invention aims in particular to provide measurements carried out according to this method for the custom-made manufacture of a shoe, in the case where a foot is measured, or else of a fashion accessory, typically a jewel, to from the measurement of the foot or another part of the body such as a person's hands or neck.
    The invention makes it possible in particular to estimate only the characteristic dimensions of the part of the body which it is desired to measure which will be useful for custom manufacturing.
    Summary of the invention
    The invention thus relates more precisely to a method of measuring a part of the human body from digital photographs, without 3D reconstruction of the part of the body, comprising the following steps:
    - the acquisition using a photographic acquisition device of at least one photograph of the body part and of a known 2D test pattern comprising at least three markers, so that the photograph contains entirely at least a dimension characteristic of the part of the body that one wishes to determine and the three markers of the target;
    - the calibration of the photographic acquisition device from said at least one photograph by the establishment of a calibration matrix allowing the correspondence between a point of the photograph and a 3D point expressed in a world coordinate system;
    - Determining the characteristic dimension of the body part from said at least one photograph and from the calibration matrix.
    Preferably, the characteristic dimension of the body part is a Euclidean distance between two points of the body part or a perimeter of the body part.
    According to one implementation, at least one characteristic dimension of the body part is determined from a single photograph and from the calibration matrix, the matrix making it possible to make the correspondence between a point of the photograph and a 3D point located in the target plane and expressed in the world coordinate system.
    According to one implementation, at least two photographs are acquired with the photographic acquisition device in two different positions so that each photograph contains said at least one characteristic dimension to be determined, the transformation between the positions of the two photographs is estimated during calibration, and determining said at least one characteristic dimension knowing said transformation.
    According to one implementation, at least one characteristic dimension of Euclidean distance type between two points is determined from two photographs, said two photographs being acquired in a translational movement of the photographic acquisition device.
    According to one implementation, at least one characteristic dimension of perimeter type is determined from n photographs taken in n different positions around the body part, n being greater than or equal to two, typically between 3 and 10 photographs.
    In this case, the length of the apparent diameter di on the photograph i is preferably measured on each photograph i, i ranging from 1 to n, and the perimeter p is estimated using the following formula:
    7Γ n
    Ρ = -ΣΛ n i = i
    Advantageously, the photographic acquisition device is a camera of a smart phone.
    According to one implementation, the photographs are transmitted to a remote computer to carry out the steps of calibration and determination of the characteristic dimension (s) of the body.
    According to an implementation, the following steps are carried out:
    - we express the plane formed by the 2D target in the world frame;
    - A generic 3D model of the part of the body to be measured is superimposed on said at least one photograph, the model being previously calibrated with actual generic dimensions of the part of the body to be measured, and;
    - the 3D model is deformed on the photograph so as to make characteristic points belonging to the plane formed by the 2D test pattern of the photograph and the 3D model coincide;
    - the characteristic dimension is determined from the deformed 3D model.
    According to one implementation, the acquisition of the photographs is guided by means of visual indications, such as the transparent display in the photograph of a drawing of the body part and the test pattern, or by means of indications. audible such as a beep or tactile indications such as vibrations preferably signaling that the gesture made for the acquisition is not the right one.
    According to one implementation, a foot is measured, and the characteristic dimension of the foot measured is a characteristic dimension useful for a bootmaker, preferably chosen from a length, a width, a height, a perimeter of a part of the foot.
    Preferably, at least one characteristic dimension of at least one measurement point of the following foot is determined:
    - the shoe size ;
    - finger size;
    - the kick;
    - the entrance;
    - the malleolus;
    - ankle ;
    - the strong point of the calf;
    - the under knee; and
    - the small toe-heel, and preferably determining at least one characteristic dimension for each of said measurement points.
    According to one implementation, at least two photographs are acquired during at least one of the following movements (a) to (d):
    (a) a translational movement of the photographic acquisition device above the foot, preferably in a substantially horizontal plane and in a direction perpendicular to the length of the foot;
    (b) a translational movement of the photographic acquisition device inside and outside the foot, preferably in a substantially vertical plane and in a direction parallel to the length of the foot;
    (c) a rotational movement of the photographic acquisition device around the ankle;
    (d) a movement of rotation of the photographic acquisition device around the leg, and at least one of the dimensions characteristic of the following measurement points is determined according to the movements of the photographic acquisition device during the acquisition of the photographs:
    - the size of the finger and / or the kick from the photographs acquired according to the movement (a);
    - the size and / or the size of the finger and / or the kick and / or the entry and / or the malleolus from the photographs acquired according to the movement (b);
    - the entry and / or the ankle from the images acquired according to the movement (c);
    - the strong point of the calf and / or the knee and / or the small toe-heel from the photographs acquired according to the movement (d).
    Depending on an implementation, a hand or a neck is measured.
    According to a second aspect, the present invention relates to a method of manufacturing a shoe, in which:
    at least one characteristic dimension of the foot is determined by the measurement method according to the invention, preferably at least the size, and even more preferably the dimensions characteristic of all of the following measurement points: the size, the size of the finger, the kick, the entry, the malleolus, the ankle, the strong point of the calf, the under knee, and the small toe-heel; and
    - A shoe is made to measure from said at least one characteristic dimension of the foot, and preferably from the dimensions characteristic of all said measurement points.
    According to a third aspect, the present invention relates to a method of manufacturing a fashion accessory adapted to the morphology of a part of the human body, in which:
    - at least one characteristic dimension of the body part, preferably a hand, a neck or a foot, is determined by the method according to the invention, and preferably the diameter of a finger of the hand, the diameter of the wrist, the diameter of the neck, or the diameter of a part of the foot such as the ankle; and
    - Said fashion accessory is made to measure from said at least one characteristic dimension.
    Other objects and advantages of the invention will appear on reading the following description of examples of particular embodiments of the invention, given by way of non-limiting examples, the description being given with reference to the appended figures described below. -after.
    Brief description of the figures
    FIG. 1A illustrates an exemplary implementation of the measurement method according to the invention comprising taking a photograph (s) with a smart phone of a human foot placed on a staff.
    Figure 1B is an example of a 2D test pattern used for the calibration of the photographic acquisition device.
    FIGS. 2A and 2B illustrate an implementation of the invention in which a length such as the length of a foot (shoe size) is determined by means of a 2D target and a photograph. Figure 2A is a diagram of the shooting of the foot and the target. FIG. 2B represents the photograph acquired during the shooting according to FIG. 2A.
    Figures 3A and 3B illustrate an implementation of the invention in which a length such as the length of a foot (shoe size) is determined by means of a 2D target and two photographs. Figure 3A is a diagram of the shooting of the foot and the target. FIG. 3B represents two photographs acquired during the shooting according to FIG. 3A.
    FIGS. 4A and 4B illustrate an implementation of the invention in which a perimeter of the foot is determined, in particular the perimeter of the kick, by means of a 2D test pattern and three photographs. Figure 4A is a diagram of the shooting of the foot and the target. FIG. 4B represents the three photographs acquired during the shooting according to FIG. 4A.
    FIG. 5 illustrates the different measurement points of a foot that can be determined by the method according to the invention.
    FIG. 6 illustrates the gestures carried out for the acquisition of the images according to an implementation of the invention.
    In the figures, the same references designate identical or analogous elements.
    Detailed description of the invention
    The present invention relates to a method of measuring a part of the human body from digital photographs using a digital photographic acquisition device, a test pattern and a specific algorithmic processing of the acquired photographs.
    Advantageously, the measurement according to the invention is not based on a 3D reconstruction of the body part, as may be the case with known methods. Such a 3D reconstruction of an object mainly means that the entire study object is reconstructed, that is to say that a 3D representation of the object is obtained from a set of images of the object taken from different angles. We then conceive that from this 3D reconstruction, we could estimate any dimension that we would like to know about the object of study. However, 3D reconstruction of an object generally calls for complex image acquisition and processing procedures, often costly in computation time. This approach by 3D reconstruction of the object was not adopted by the inventors.
    The present invention thus provides a method of measuring a part of the human body from digital photographs, without 3D reconstruction of said part of the body, which allows the estimation of dimensions characteristic of said part of the body.
    The process includes the following steps:
    - the acquisition using a photographic acquisition device of at least one photograph of the body part and of a known 2D test pattern comprising at least three markers, so that the photograph contains entirely at least a dimension characteristic of the part of the body that one wishes to determine and the three markers of the target;
    - the calibration of the photographic acquisition device from said at least one photograph by the establishment of a calibration matrix allowing the correspondence between a point of the photograph and a 3D point expressed in a world coordinate system;
    - Determining the characteristic dimension of the body part from said at least one photograph and from the calibration matrix.
    In particular because the method according to the invention is not based on a 3D reconstruction of said part of the body, but also because of the flexibility of shooting implemented and the type of image processing carried out, detailed below in the description, the present process is simple and robust.
    Several parts of the human body such as the feet, the hands or even the neck can thus be measured with the method according to the invention.
    In particular, the present invention relates to a method for measuring a foot, allowing the determination of characteristic dimensions of the foot useful to a shoemaker for the manufacture of custom-made shoes.
    In the following description, the method according to the invention is described in the case of measuring a foot.
    Beforehand, certain terms used in the present description are specified below.
    The term foot in the present description is understood to include the foot as such, as well as a part of the leg extending to the knee. The term included here all parts of the foot and leg whose measurement is useful to a bootmaker.
    Similarly, the term hand used in the present description includes the hand as such as the wrist, or even the part of the arm going up to the elbow. It refers to all parts of the hand and arm, the measurement of which is useful in the manufacture of a jewelry-type fashion accessory, for example a ring or a bracelet.
    In the present description, the term smartphone, taken from Anglo-Saxon terminology, is used to designate a smart phone, which conventionally includes a camera.
    By photography is meant an image obtained by a photographic process, that is to say obtained by the action of light on a sensitive surface. The term image will also be used in the present description to designate a photograph. The present invention relates exclusively to the use of digital photographs.
    By world reference frame, we mean an orthonormal reference frame associated with the real three-dimensional space where the object of study is located, that is to say the part of the body that we wish to measure. We can note this reference R o , of origin 0: (R o , X ^, Ÿo, Z ^.
    FIG. 1A schematically illustrates a view of the process according to the invention. A stand 10 is placed on a two-dimensional (2D) test pattern 30 carrying identifiable markers 40.
    The shooting is for example carried out by means of a smartphone 20, conventionally comprising a camera. The use of such a non-dedicated and widely used image acquisition device is advantageous. In addition, the use of a smartphone allows a simple, freehand shooting, which can be carried out by the person himself who seeks to measure a part of his body, or possibly by a third party.
    The smartphone's photo sensor can be used in both photography and video mode, provided the image quality and resolution allow. In video mode, part of the images acquired by the sensor are then used.
    The target 30 is placed so as to be visible by the image acquisition device, like the foot 10 to be imaged. The target 30 can be placed under or next to the foot to be imaged.
    At least one image of the foot 10 and of the test pattern 30 is acquired by the smartphone 20, so that the image entirely contains the characteristic dimension or dimensions of the foot 10 that it is desired to determine, as well as at least three markers 40 of the target 30.
    Target 30 is used to calibrate the image acquisition device. This calibration target includes reference elements of known geometry. Thus, the test pattern 30 has at least three markers 40 which form identifiable figures in the image, for example black dots on a white background or vice versa, or any other identifiable pattern, preferably capable of being detected automatically. in the picture. An example of a test pattern 30 is illustrated in FIG. 1 B. It is a simple sheet of A4 paper comprising locatable markers 40 at the four corners of the sheet, referenced 1 to 4 in FIG. 1B. The standardized dimensions of such a sheet are known. Markers can be placed differently on the sheet, as long as you know the distance between them and / or their size.
    The 2D target 30 is known, that is to say that geometric information is available on the markers 40 (at least three) of the target, typically the distance between the markers 40 and / or the size of the markers, and allows the calculation of the position of the image acquisition device in space, expressed in the world reference frame. This calibration step of the image acquisition device then makes it possible to determine characteristic dimensions of the object studied, e.g. the foot, from the points in the image, i.e. allows a calibrated measurement. This type of calibration is known, and for example described in the work of Richard Hartley and Andrew Zisserman entitled “Multiple View Geometry in computer vision” (Part I: Camera Geometry and Single View Geometry. Cambridge University Press, p. 151-233 , 2004). The calibration of the image acquisition device consists in establishing, from at least one photograph taken as described above, a calibration matrix allowing the correspondence between a point of the image and a 3D point expressed in a frame. world.
    For each image acquired, the positions in the image of at least three markers 40 of the test pattern 30 are extracted. This extraction can be carried out manually: an operator points using a pointing device, such as for example a mouse, or even a finger or a conducting point if a contact on a touch screen is used, the positions of the 40 markers. This extraction can also be carried out automatically with certain image processing techniques, such as for example described in Lowe, 1999 (“Object recognition from local scale-invariant features”, Proceedings of the International Conference on Computer Vision , vol. 2, 1999). Preferably, automatic extraction is based on a technique as described in Lowe 1999, having the particularity of being able to match a pattern representing the marker without being sensitive to projective geometric transformations. Once these positions have been extracted, it is possible to calculate a calibration matrix, as described for example in Hartley and Zisserman, 2004 (“Multiple View Geometry in computer vision”, 2004, Part I “Camera Geometry and Single View Geometry” and Part II "Two-View Geometry", Cambridge University Press, p. 151-233 and p. 237-308), allowing to correspond between the positions of the points in the image and the 3D positions of the points in the plane of the target 30 in the world benchmark. Measurements of real distances between two points can then be made, as illustrated in FIGS. 2A / B, 3A / B, 4A / B described below.
    Thus, once the calibration has been carried out, the characteristic dimension of the stand can be determined from the calibration matrix and from at least one image.
    The method according to the invention makes it possible in particular to determine a length of a part of the body, that is to say a Euclidean distance between two points of a part of the body. It can be the length, width or height of a part of the body, according to the usual definition of these dimensions (length: distance between the two most distant ends of an object / width: dimension perpendicular to the length / height: dimension in the vertical direction, from the base to the top of an object). The characteristic dimension measured can also be a perimeter of the body part, which can be defined as a distance between two points by being forced to remain on a 3D surface.
    The length of the body part, for example the length of the foot (size), can be determined directly from one or more images, knowing the length between two points in the image, and knowing the correspondence between the points of the image and the 3D points in the world benchmark with the calibration matrix.
    The perimeter of a 3D surface of the part of the body of interest is preferably calculated from several images according to a method based on a principle known from the field of stereology, described in Bobenko et al., 2008 ("Discrete Differential
    Geometry, Bobenko, "A.I., Schroder, P., Sullivan, J.M., Ziegler, G.M. (Eds.), Birkhàuser,
    2008, DOI 10.1007 / 978-3-7643-8621-4, p. 149). The method is described below in relation to FIGS. 4A and 4B. The perimeter can also be estimated from a single image. In this case, we measure a length in the image which is an approximation of the perimeter of the body part. This approximation can be satisfactory if, for example, we can assume that the body part to be measured looks like a cylinder.
    The calculations of the calibration step and the determination of the characteristic dimensions of the stand can be carried out directly by the image acquisition device, in the case where the latter comprises calculation means as is the case for a smartphone conventionally comprising a laptop. In this case the smartphone includes the program allowing the processing of the images for the calibration and for the measurement of the characteristic dimension of the foot. Alternatively, these calculations can be performed remotely, by an external computer-type device with the program for calibration and measurement. In this case, the information is transmitted from the image acquisition device to the computer by wired connection, for example via a USB key, a memory card, etc., or by wireless connection, for example WIFl, cellular etc. .
    In the case of an image transfer, it is possible to make the images anonymous by removing any distinctive sign, for example moles or tattoos, from the images before their transfer.
    FIGS. 2A and 2B illustrate an implementation of the method for measuring a length according to the invention from an image.
    According to this implementation, at least one characteristic dimension of the body part is determined from a single image and from the calibration matrix, the latter allowing the correspondence between a point of the image and a 3D point. located in the target plane and expressed in the world coordinate system.
    As in FIG. 1A, a foot 10 is placed on a 2D target 30 carrying identifiable markers 40. The shooting is carried out by means of the smartphone 20. A photograph of the foot 10 and of the target 30 is acquired by the smartphone 20 , so that the image entirely contains the characteristic dimension of the foot 10 that one wishes to determine, ie the length of the foot 50, corresponding to the size, as well as at least three markers 40 of the test pattern 30. The test pattern 30 is a simple sheet of white A4 paper comprising markers 40 in the form of black circular dots at the four corners, as illustrated in FIG. 1B.
    For the calibration step, the positions in image 21 of at least three markers 41 of the test pattern 31 are determined, as explained above. Knowing the position of the markers 40 of the test pattern 30 in the world benchmark, the calibration matrix of the photographic sensor is then established which makes it possible to make the correspondence between the positions of the points in the image and the 3D positions of the points in the plane of the target in the world frame (also called space of objects or object frame). This calibration method is known (Hartley and Zisserman, 2004: “Multiple View Geometry in computer vision”, 2004, Part I “Camera Geometry and Single View Geometry >>, Cambridge University Press, p. 151-233).
    Once the calibration step has been carried out, the actual length of the foot 50 is determined from the length 51 extracted from the image 21. For this step, it is assumed that the object observed, ie the foot, is in the plane formed by the test pattern 30. The measurements are then very satisfactory for all the points of the foot present in the plane of the test pattern, and more and more approximate when the points move away from this plane.
    According to this implementation, a dimension of length type is preferably determined, i.e. a Euclidean distance between two points. In the case of the measurement of a foot, other types of characteristic dimensions than the length of the foot 50 (size) can be determined according to this implementation, such as for example the length and the width of different parts of the foot of preferably measured at the base of the foot (points of the foot located on the target), such as the dimensions referenced 2b, 2c, 2d, 3b, 3c, 3d, and 9 in table 1 below, and partly illustrated in the figure 5.
    According to this implementation, it is also possible to determine a perimeter of a part of the body, if we formulate a hypothesis on the geometric shape of the part of the body in question, for example if we consider that said part has a cylindrical shape. In this case, the actual perimeter can be approximated by a single measurement of the apparent diameter of the body part in the image.
    FIGS. 3A and 3B illustrate an implementation of the method for measuring a length according to the invention from two images.
    According to this implementation, at least two images are acquired with the image acquisition device placed in two different positions so that each image contains at least one characteristic dimension to be determined, and the characteristic dimension is determined by triangulation at from said at least two photographs.
    This implementation is based on a triangulation approach for calibration, known and for example described in Hartley and Zisserman, 2004 (“Multiple View Geometry in computer vision”, 2004, Part II “Two-View Geometry >>, Cambridge University Press , pp. 237-308).
    As in FIGS. 1A and 2A, a stand 10 is placed on a 2D test pattern 30 comprising identifiable markers 40. The shooting is carried out by means of the smartphone 20.
    At least two images 21 and 22 of the foot 10 and of the test pattern 30 are acquired by the smartphone 20 placed in two different positions (a) and (b), so that each image (21, 22) entirely contains the characteristic dimension of the foot 10 that one wishes to determine, ie the length of the foot 50 (shoe size), as well as at least three same markers 40 of the test pattern 30. In images 21 and 22, the length of the actual foot 50 is referenced respectively 51 and 52, the foot 10 is referenced 11 and 12, the three markers 40 of the test pattern 30 are referenced 41 and 42. The test pattern 30 is identical to that described for FIG. 2A.
    Thus, for each characteristic dimension that one wishes to determine, there are at least two images acquired by the smartphone 20 in different positions. By estimating the transformation T (represented by a double arrow in FIG. 3A) between the two positions (a) and (b) of the two images 21 and 22 in the world frame using the test pattern 30, we can determine the real 3D coordinates of the points of the image.
    The estimation of the transformation T can be carried out by different methods. The use of a 2D target with at least 3 visible markers in the images is required. The estimation of the transformation T can be carried out as follows: in order to be able to estimate the movement of the smartphone between two shots, a paper test pattern on which there are four markers is used. The movement of the image acquisition device, e.g. the smartphone, from one view to another is determined by the transformation matrix allowing to pass from the four markers from the first image to the second image.
    Let M be the 3x3 displacement matrix with mij the coefficient at line i and at column j:
    m nm 12 m 13
    M = m 21 m 22 m 23 m 31 m 32 m 33
    Let G1, G2, G3 and G4 be the markers of image 1, and D1, D2, D3, D4 the corresponding markers of image 2. The values of the coefficients mij are obtained by matching the markers between the two images as a system and solving it by a least square method.
    The system to be solved is written in the form:
    D1 X D1 y 1 0 0 0 -G1 X * D1 X -G1 x * D1 y -G1 y = 0
    0 0 D1 X D1 y 1 -G1 y * D1 x -G1 y * D1 y -G1 y = 0 etc.
    The transformation in space is then defined as follows:
    Rotation with respect to the Z axis = asin (m 2 i)
    Translation relative to the X axis = m 13 T ranslation relative to the Y axis = m 23 T ranslation relative to the Z axis = m 33 Scale factor along the X axis = m 11 / cos ( asin (m 21 ))
    Scale factor along the Y axis = m 21 / cos (asin (m 21 ))
    Knowing the correspondence between a 3D point in the world coordinate system and a point in each of the two images (calibration matrix), we can then determine a distance between two points in space from the two images.
    According to this approach, we do not assume that the object must be in the plane formed by the target, unlike the implementation with a single image.
    On the other hand, the measurement error evolves in the same way as for the implementation with an image described in relation to FIGS. 2A and 2B: the measurements are very satisfactory for all the points of the foot close to the plane of the target, and more and more approximate when the points move away from this plane.
    According to this implementation, it is thus possible to determine a dimension characteristic of the part of the image body, preferably a dimension of length type, i.e. a Euclidean distance between two points, knowing the transformation between two images. In the case of the measurement of a foot, other types of characteristic dimensions than the length of the foot 50 (size) can be determined according to this implementation, such as for example the length, the width, the height of different parts. of the foot, such as the dimensions referenced 2b, 2c, 2d, 2e, 3b, 3c, 3d, 3e, 4b, 4c, 5a, 5b, 6b, 6c and 9 in table 1 below, and partly illustrated in figure 5.
    According to this implementation, it is also possible to determine a perimeter of a part of the body, if we formulate a hypothesis on the geometric shape of the part of the body in question, for example if we consider that said part has a cylindrical shape. In this case, the actual perimeter can be approximated by a single measurement of the apparent diameter of the body part in the image.
    According to an implementation of the measurement method, at least one characteristic dimension of perimeter type is determined from n photographs taken in n different positions around the part of the body to be measured, n being greater than or equal to two, typically between 3 and 10 photographs, preferably between 3 and 5 photographs.
    In particular, the perimeter of a part of the body is determined by measuring on each photograph i, i ranging from 1 to n, the length of the apparent diameter di, and the perimeter p is estimated using the following formula (IV):
    Ρ = -ΤΛ (iv) n i = i
    This estimation is based on a principle known in the field of stereology, for example mentioned in Bobenko et al., 2008 (“Discrète Differential Geometry, Bobenko,” AI, Schroder, P., Sullivan, JM, Ziegler, GM (Eds .), Birkhàuser, 2008, DOI 10.1007 / 978-3-7643-8621-4, p. 149), based on a lemma according to which the length of a curve γ c S d1 is equal to π times the average intersections of γ with large hyperspheres S d 2 .
    This estimate provides a satisfactory measure, especially if the 3D surface is convex and the number of images n tends to infinity.
    FIGS. 4A and 4B illustrate an example of such an implementation, in which three images 21, 22 and 23 are acquired around a stand 10 placed on a test chart 30 carrying markers 40. The test chart is identical to that described in relation to the previous figures. The smartphone 20 is therefore placed in 3 different positions (c), (d), and (e) around the foot 10. In each of the images 21, 22, 23, the kick to be measured is visible, as well as the 3 markers 40 (references 41, 42, 43) of the test pattern 30 (references 31, 32, 33).
    The perimeter 60, at the level of the kick, is determined by measuring in each image 21,22, and 23, the apparent diameter 61,62 and 63, and by applying the formula (IV).
    According to this implementation, the calibration step is carried out as described in relation to FIGS. 2A and 2B. Once the calibration matrix has been established, it is possible to determine the actual length of the apparent diameter di measured in the image, and thus to estimate the perimeter using the formula (IV).
    According to another implementation, the measurement method comprises the following steps:
    - we express the plane formed by the 2D target in the world frame, for example with the knowledge of the position of at least 3 markers of the target;
    - A generic 3D model of the body part to be measured is superimposed on at least one acquired image, the model being previously calibrated with actual generic dimensions of the body part to be measured, and;
    - the 3D model projected on the image is deformed so as to make characteristic points belonging to the plane formed by the 2D test pattern of the photograph and the 3D model coincide;
    - the characteristic dimension, length or perimeter, is determined from the deformed 3D model.
    The deformation of the 3D model can be carried out manually, with the intervention of an operator who modifies the points of the model using a pointing device or automatically by the implementation of an algorithm which adjust the position of the points in order to satisfy a given criterion. The deformation of the 3D model is global, that is to say that from the matching of the characteristic points belonging to the plane formed by the 2D test pattern of the photograph and the 3D model, the 3D model is modified in its together. For example, if we make the base of the 3D model coincide with the length of the foot, we then deform the entire 3D model of the foot in proportion to the transformation of the base of the 3D model.
    According to another implementation of the method, the acquisition of the photographs is guided by means of visual indications, such as the transparent display in the photograph of a drawing of the body part and the test chart, or by means of audible indications such as a beep or tactile indications such as vibrations. These indications can for example signal that the gesture made for the acquisition is not the right one, in which case the person who manipulates the image acquisition device will modify the shooting.
    The measurement method according to the invention advantageously applies to the measurement of a foot, as illustrated in the various figures, and makes it possible to determine a characteristic dimension of the foot which is a characteristic dimension useful for a shoemaker, preferably chosen from a length, a width, a height, a perimeter of a part of the foot.
    At least one characteristic dimension of at least one measurement point of the following foot is determined with the method according to the invention:
    - the shoe size ;
    - finger size;
    - the kick;
    - the entrance;
    - the malleolus;
    - ankle ;
    - the strong point of the calf;
    - the under knee; and
    - the little toe-heel.
    These different measurement points are listed in table 1 below, referenced from 1 to 9, and their position is illustrated in FIG. 5. In FIG. 5, the diagram (A) represents a top view of the foot, and the diagrams (B), (C) and (D) of the side views of the foot. The different characteristic dimensions associated with each measurement point are also listed in Table 1.
    Preferably, we measure at least the size, even more preferably we measure at least the size, the size of the fingers, the kick, the entry, and the malleolus, and more preferably still we measure all these measurement points, that is to say at least one characteristic dimension for each of said measurement points, and preferably all the dimensions listed in Table 1 associated with each measurement point.
    Point Designation Type 1 Shoe size 2 Finger size 2a.perimeter 2b.distance from the heel to the size of the toes of the inside of the foot 2d. Distance from heel to size of the toes of the outside of the foot 2d. Foot width to finger size 2nd height from foot to finger size 3 Kick 3a.perimeter 3b. Distance from the heel to the size of the toes of the inside of the foot 3c distance from heel to the size of the toes of the outside of the foot 3d. Width 3rd height 4 Entrance 4a.perimeter 4b. Width 4c. Height 5 Malleolus 5a. Height of the internal malleolus 5b. Height of the external malleolus 6 Ankle 6a.perimeter 6b. Width 6c. Height 7 Strong point of the calf Perimeter (can be approximated by an ellipse) 8 Below knee Perimeter (can be approximated by an ellipse) 9 Small toe-heel Distance from heel to small toe
    Table 1
    According to an implementation of the method for measuring the foot, a shot is taken of at least two images acquired using a simple gesture, which can include at least one of the following movements (a) to (d):
    (a) a translational movement of the photographic acquisition device above the foot, preferably in a substantially horizontal plane and in a direction perpendicular to the length of the foot;
    (b) a translational movement of the photographic acquisition device inside and outside the foot, preferably in a substantially vertical plane and in a direction parallel to the length of the foot;
    (c) a rotational movement of the photographic acquisition device around the ankle;
    (d) a rotational movement of the photographic acquisition device around the leg.
    At least one of the characteristic dimensions of the following measurement points is then determined according to the movements of the image acquisition device during the acquisition:
    - the size of the finger (2) and / or the kick (3) from the photographs acquired according to the movement (a);
    - the size (1) and / or the size of the finger (2) and / or the kick (3) and / or the entry (4) and / or the malleolus (5) from the photographs acquired according to the movement (b);
    - the input (4) and / or the ankle (6) from the images acquired according to the movement (c);
    - the strong point of the calf (7) and / or the under knee (8) and / or the little toe-heel (9) from the photographs acquired according to the movement (d).
    Preferably, in order to determine a large number of characteristic dimensions of the foot, for example dimensions for all the measurement points 1 to 9, images are acquired by making 5 gestures corresponding to the movements (a) to (d).
    Figure 6 illustrates the described gestures associated with the acquisition of images. In its identifiable markers 40, before taking images. In the diagrams (B) to (F), the movements of the smartphone 20 are indicated by arrows. The diagram (B) illustrates the translational movement 70 of the smartphone 20 above the foot 10 and the target 30, carried out in a substantially horizontal plane and in a direction perpendicular to the length of the foot so. This movement makes it possible to determine characteristic dimensions for the size of the fingers (2) and the kick (3). The diagram (C) illustrates the translational movement 71 of the smartphone 20 which is a translational movement inside the foot, in a substantially vertical plane and in a direction parallel to the length of the foot. A shot according to this movement makes it possible to determine characteristic dimensions relating to the size (1), the size with the fingers (2), the kick (3), the entry (4) and the malleolus ( 5). A shot in an identical translational movement but outside the foot, as shown in the diagram (D), makes it possible to determine the characteristic dimensions of the same measurement points. Images taken according to the rotational movement 73 around the ankle illustrated in the diagram (E), allow measurements of the entry (4) and the ankle (6). Finally the diagram (F) illustrates a rotational movement 74 around the leg wider than that around the ankle, allowing measurements at the level of the strong point of the calf (7), the under-knee (8), and the small toe-heel (9).
    It is understood that the images acquired according to different movements can be used to determine a given characteristic dimension.
    This very simple gesture, which can be carried out by the person himself, makes it possible to provide all the information necessary for the measurement according to the method, in order to deliver the useful measurements to a shoemaker for the manufacture of custom-made shoes.
    During gestures, triggers for taking images can be performed by the user or automatically by the image acquisition device. In this case, an automatic follow-up in the image of the target can be carried out, and / or a follow-up of the information of inclinations and displacements by means of an accelerometer can also be carried out.
    The various implementations described can be combined without departing from the scope of the present invention. By way of example, it is possible to implement in the same process both the determination of a length from a single image, and / or the determination of a length from several images, and / or the determination of a perimeter from n images. Many combinations are possible.
    One aspect of the invention relates to a tailor-made method of manufacturing a shoe, in which at least one characteristic dimension of the foot is determined by the measurement method described, and a custom-made shoe is produced from said at minus a characteristic dimension of the foot.
    Preferably at least the size is determined, and even more preferably the dimensions characteristic of all the following measurement points: the size, the size of the finger, the kick, the entry, the malleolus, the ankle, the strong point calf, under knee, and little toe-heel, in order to provide these measurements to the bootmaker for the manufacture of the shoe.
    Preferably, the shoe is made to measure from the characteristic dimensions of all the measurement points listed above.
    The measurement method according to the invention can advantageously be applied to the measurement of another part of the human body than the foot, such as a hand or a neck.
    Another aspect of the invention relates to the production of a mode adapted to the morphology of a part of the human body, in which at least one dimension characteristic of said part of the body, preferably with one hand, of the body, is determined. neck or foot, by the measurement method described, and the custom-made fashion accessory is produced from said at least one characteristic dimension.
    Preferably, the diameter of a finger of the hand, the diameter of the wrist, the diameter of the neck, or the diameter of a part of the foot such as the ankle are measured, for example to make a custom-made piece of jewelry such as a ring, a bracelet, a necklace, or any other adornment. We can also measure the dimensions of a hand necessary for example to make custom gloves.
    权利要求:
    Claims (17)
    [1" id="c-fr-0001]
    1. Method for measuring a part of the human body from digital photographs, without 3D reconstruction of said part of the body, comprising the following steps:
    the acquisition using a photographic acquisition device of at least one photograph of said part of the body and of a known 2D test pattern comprising at least three markers, so that said photograph contains entirely at least a dimension characteristic of said part of the body which it is desired to determine and the three markers of said target;
    - the calibration of the photographic acquisition device from said at least one photograph by the establishment of a calibration matrix allowing the correspondence between a point of said photograph and a 3D point expressed in a world coordinate system;
    - Determining said characteristic dimension of said body part from said at least one photograph and from said calibration matrix.
    [2" id="c-fr-0002]
    2. Method according to claim 1, wherein said at least one dimension characteristic of said part of the human body is a Euclidean distance between two points of said part of the body or a perimeter of said part of the body.
    [3" id="c-fr-0003]
    3. Method according to one of the preceding claims, in which at least one dimension characteristic of said body part is determined from a single photograph and from the calibration matrix, said matrix making it possible to achieve the correspondence between a point of said photograph and a 3D point located in the target plane and expressed in the world reference frame.
    [4" id="c-fr-0004]
    4. Method according to one of the preceding claims, in which at least two photographs are acquired with the photographic acquisition device in two different positions so that each photograph contains said at least one characteristic dimension to be determined, the transformation is estimated. between the positions of the two photographs during calibration, and determining said at least one characteristic dimension knowing said transformation.
    [5" id="c-fr-0005]
    5. Method according to the preceding claim, wherein at least one characteristic dimension of Euclidean distance type between two points is determined from two photographs, said two photographs being acquired in a translational movement of the photographic acquisition device.
    [6" id="c-fr-0006]
    6. Method according to one of the preceding claims, in which at least one characteristic dimension of perimeter type is determined from n photographs taken in n different positions around the body part, n being greater than or equal to 2 and preferably between 3 and 10 photographs.
    [7" id="c-fr-0007]
    7. Method according to claim 6, in which a perimeter of a part of the body is determined by measuring on each photograph i, i ranging from 1 to n, the length of the apparent diameter di in photograph i, and the perimeter is estimated. p using the following formula:
    7Γ n
    P = ~ TA n i = i
    [8" id="c-fr-0008]
    8. Method according to one of the preceding claims, wherein the photographic acquisition device is a camera of a smart phone.
    [9" id="c-fr-0009]
    9. Method according to one of the preceding claims, in which the photographs are transmitted to a remote computer to carry out the steps of calibration and determination of said at least one dimension characteristic of the human body.
    [10" id="c-fr-0010]
    10. Method according to one of the preceding claims, in which:
    - we express the plane formed by the 2D target in the world frame;
    - A generic 3D model of the part of the body to be measured is superimposed on said at least one photograph, said model being previously calibrated with actual generic dimensions of the part of the body to be measured, and;
    - said 3D model is deformed on the photograph so as to make characteristic points belonging to the plane formed by the 2D test pattern of the photograph and the 3D model coincide;
    - Said at least one characteristic dimension is determined from the deformed 3D model.
    [11" id="c-fr-0011]
    11. Method according to one of the preceding claims, in which the acquisition of the photographs is guided by means of visual indications, such as the transparent display in the photograph of a drawing of the body part and the test pattern. , or by means of audible indications such as a beep or tactile such as vibrations preferably signaling that the gesture made for the acquisition is not the right one.
    [12" id="c-fr-0012]
    12. Method according to one of the preceding claims for measuring a foot, wherein said at least one characteristic dimension of the measured foot is a characteristic dimension useful for a bootmaker, preferably chosen from a length, a width, a height. , a perimeter of part of the foot.
    [13" id="c-fr-0013]
    13. The method of claim 12, wherein at least one characteristic dimension of at least one measurement point of the following foot is determined:
    - the shoe size ;
    - finger size;
    - the kick;
    - the entrance;
    - the malleolus;
    - ankle ;
    - the strong point of the calf;
    - the under knee; and
    - the small toe-heel, and preferably at least one characteristic dimension for each of said measurement points.
    [14" id="c-fr-0014]
    14. Method according to one of claims 12 and 13, in which at least two photographs are acquired during at least one of the following movements (a) to (d):
    (a) a translational movement of the photographic acquisition device above the foot, preferably in a substantially horizontal plane and in a direction perpendicular to the length of the foot;
    (b) a translational movement of the photographic acquisition device inside and outside the foot, preferably in a substantially vertical plane and in a direction parallel to the length of the foot;
    (c) a rotational movement of the photographic acquisition device around the ankle;
    (d) a rotational movement of the photographic acquisition device around the leg, and in which at least one of the dimensions characteristic of the following measurement points is determined according to the movements of the photographic acquisition device during the acquisition of the photographs:
    - the size of the finger and / or the kick from the photographs acquired according to the movement (a);
    - the size and / or the size of the finger and / or the kick and / or the entry and / or the malleolus from the photographs acquired according to the movement (b);
    - the entry and / or the ankle from the images acquired according to the movement (c);
    - the strong point of the calf and / or the knee and / or the small toe-heel from the photographs acquired according to the movement (d).
    [15" id="c-fr-0015]
    15. Method of manufacturing a shoe, in which:
    - at least one characteristic dimension of the foot is determined by the method according to one of the preceding claims, preferably at least the size, and even more preferably the dimensions characteristic of all of the following measurement points: shoe size, finger size , the kick, the entry, the malleolus, the ankle, the strong point of the calf, the under knee, and the small toe-heel; and
    - A tailor-made shoe is produced from said at least one characteristic dimension of the foot, and preferably from the dimensions characteristic of all said measurement points.
    [16" id="c-fr-0016]
    16. Method according to one of claims 1 to 11 for the measurement of a hand or a neck.
    [17" id="c-fr-0017]
    17. Method of manufacturing a fashion accessory adapted to the morphology of a part of the human body, in which:
    - at least one characteristic dimension of said part of the human body is determined by the method according to one of claims 1 to 11, preferably at least one characteristic dimension of a hand, a neck, or a foot, and preferably the diameter of a finger of the hand, the diameter of the wrist, the diameter of the neck, or the diameter of a part of the foot such as the ankle; and
    - Said tailor-made fashion accessory is produced from said at least one characteristic dimension.
    1/5
    类似技术:
    公开号 | 公开日 | 专利标题
    FR3060735A1|2018-06-22|METHOD FOR MEASURING A PART OF THE BODY FROM DIGITAL PHOTOGRAPHS, AND IMPLEMENTING SUCH A METHOD FOR MANUFACTURING CUSTOM SHOES
    EP2272047B1|2012-03-14|3d imaging system
    EP2870428A1|2015-05-13|3-d scanning and positioning system
    CN106200914A|2016-12-07|The triggering method of augmented reality, device and photographing device
    US20200082572A1|2020-03-12|Techniques for capturing dynamic appearance of skin
    EP3412245B1|2020-01-22|Process for evaluating an orthodontic splint
    EP1190208B1|2011-06-15|Method for measuring a three-dimensional object, or assembly of objects
    FR2974722A1|2012-11-09|METHOD FOR DETERMINING THE READ DISTANCE
    Benalcazar et al.2019|A 3D iris scanner from multiple 2D visible light images
    TW200939053A|2009-09-16|Apparatus and method for rapidly measuring 3-dimensional foot sizes from multi-images
    FR3069942B1|2019-08-09|ANALYSIS OF A MOVEMENT AND / OR A POSTURE OF AT LEAST ONE PART OF THE BODY OF AN INDIVIDUAL
    WO2016005688A1|2016-01-14|System and method for three-dimensional depth imaging
    FR3071715B1|2019-11-01|RADIOGRAPHIC IMAGING METHOD, RADIOGRAPHIC IMAGE PROCESSING DEVICE, AND RADIOGRAPHIC IMAGING DEVICE.
    WO2006027490A1|2006-03-16|Device for creating a full three-dimensional representation of a limb of a patient from a reduced number of measurements taken from said limb
    FR2724720A1|1996-03-22|METHOD FOR CORRELATION OF THREE-DIMENSIONAL MEASUREMENTS MADE BY IMAGE ACQUISITION SYSTEMS AND INSTALLATION FOR IMPLEMENTING SAME
    EP3633625A1|2020-04-08|Method for texturing a 3d model
    WO2017077217A1|2017-05-11|3-d calibration of a video mapping system
    FR3097997A1|2021-01-01|Process for analyzing an individual's gait
    FR3106485A1|2021-07-30|DEVICE AND METHOD FOR MEASURING A FORCE EXERCISED ON A BODY, AND CHARACTERIZATION OF THE RIGIDITY OF A BODY USING SUCH A DEVICE
    WO2020216925A1|2020-10-29|Method for evaluating an orthodontic brace
    FR2997492A1|2014-05-02|Verification plan establishment method for e.g. water pipe network, involves rebuilding apparent element, and establishing plan including apparent element that is re-built and geo-referred in predetermined geometrical reference frame
    FR2992415A1|2013-12-27|METHOD FOR ESTABLISHING A GEOLOCALIZED RECOVERY PLAN, COMPUTER PROGRAM PRODUCT AND CORRESPONDING STORAGE MEDIUM
    FR3057987A1|2018-04-27|SYSTEM AND METHOD FOR TRAINING IN THE HANDLING OF AN ECHOGRAPHIC PROBE
    WO2019129879A1|2019-07-04|Method and system for calibrating an x-ray imaging system
    FR3070784A1|2019-03-08|DEVICE AND METHOD FOR RECONSTRUCTING THE 3D SURFACE OF THE COMPLETE TURN OF A SUBJECT
    同族专利:
    公开号 | 公开日
    EP3555559A1|2019-10-23|
    FR3060735B1|2019-12-27|
    WO2018109421A1|2018-06-21|
    EA201991588A1|2019-11-29|
    引用文献:
    公开号 | 申请日 | 公开日 | 申请人 | 专利标题
    FR2882512A1|2005-02-28|2006-09-01|Mascio Gerard Di|Measuring device for geometrical characteristic of an anatomical segment comprises a data processing measurement system having an identification system, pairing system and a calculating unit|
    US20070168153A1|2006-01-13|2007-07-19|Digicontractor Corporation|Method and apparatus for photographic measurement|
    WO2013026798A1|2011-08-25|2013-02-28|Magari S.R.L.|Method and system for optimised selection of footwear or clothing articles|
    DE102011121086A1|2011-12-15|2013-06-20|Deichmann Se|Measuring system for measuring limb of children foot for shoe size determination in house, evaluates captured images of limb by automated algorithm without requiring user interaction|
    EP2641539A1|2012-03-21|2013-09-25|Rocket eleven GmbH|Method for determining the dimensions of a body part; method and apparatus for determining the dimensions of a garment|
    WO2014053137A1|2012-10-01|2014-04-10|Bodybarista Aps|A method of calibrating a camera|
    US20160286906A1|2013-11-09|2016-10-06|Edgimago 2012 Ltd.|Method and system for measuring 3-dimensional objects|US20180182123A1|2018-02-26|2018-06-28|Chien Min Fang|Method of selecting an article for covering a body part by processing the image of the body part|
    WO2021009879A1|2019-07-17|2021-01-21|株式会社アシックス|Measurement plate and foot outline creation system|
    EA036032B1|2015-05-29|2020-09-16|Юнилевер Н.В.|System and method for measuring hair diameter|
    EP3369040A1|2015-10-30|2018-09-05|Unilever Plc.|Hair curl measurement|
    MX2018005142A|2015-10-30|2018-06-06|Unilever Nv|Hair diameter measurement.|
    US10420397B2|2016-12-14|2019-09-24|Black Brass, Inc.|Foot measuring and sizing application|
    DE102019122889A1|2019-05-29|2020-12-03|eekual bionic GmbH|Method of making a seamless shoe|
    EP3878301A1|2020-03-12|2021-09-15|Base Protection Srl|Insole designing and manufacturing method|
    法律状态:
    2017-12-14| PLFP| Fee payment|Year of fee payment: 2 |
    2018-06-22| PLSC| Publication of the preliminary search report|Effective date: 20180622 |
    2018-12-19| PLFP| Fee payment|Year of fee payment: 3 |
    2019-12-24| PLFP| Fee payment|Year of fee payment: 4 |
    2020-12-29| PLFP| Fee payment|Year of fee payment: 5 |
    2021-12-27| PLFP| Fee payment|Year of fee payment: 6 |
    优先权:
    申请号 | 申请日 | 专利标题
    FR1662478|2016-12-15|
    FR1662478A|FR3060735B1|2016-12-15|2016-12-15|METHOD FOR MEASURING A PART OF THE BODY FROM DIGITAL PHOTOGRAPHS, AND IMPLEMENTING SUCH A METHOD FOR THE MANUFACTURE OF CUSTOM SHOES|FR1662478A| FR3060735B1|2016-12-15|2016-12-15|METHOD FOR MEASURING A PART OF THE BODY FROM DIGITAL PHOTOGRAPHS, AND IMPLEMENTING SUCH A METHOD FOR THE MANUFACTURE OF CUSTOM SHOES|
    EP17832789.6A| EP3555559A1|2016-12-15|2017-12-15|Method of measuring a part of the body using digital photographs, and implementation of such a method for manufacturing customized shoes|
    PCT/FR2017/053623| WO2018109421A1|2016-12-15|2017-12-15|Method of measuring a part of the body using digital photographs, and implementation of such a method for manufacturing customized shoes|
    EA201991588A| EA201991588A1|2016-12-15|2017-12-28|METHOD FOR PROCESSING INSECTS, INCLUDING SEPARATION OF THE CUTICLE FROM THE SOFT PART OF INSECTS WITH THE FOLLOWING SEPARATION OF THE SOFT PART IN THREE FACTIONS|
    [返回顶部]