Automated control of microfluidic devices based on machine learning

Giera, Brian; Duoss, Eric; Nguyen, Du; Smith, William; Talathi, Sachin Subhash; Wilson, Aaron Creighton; Ye, Congwang

Advanced Search OptionsAdvanced Search queries use a traditional Term Search. For more info, see our FAQ.

All Fields:

Patent Title:

Abstract:

Assignee:

Inventor(s):

Patent Number:

Patent Classification (CPC):

All Classifications
A - human necessities
A01 - agriculture
A21 - baking
A22 - butchering
A23 - foods or foodstuffs
A24 - tobacco
A41 - wearing apparel
A42 - headwear
A43 - footwear
A44 - haberdashery
A45 - hand or travelling articles
A46 - brushware
A47 - furniture
A61 - medical or veterinary science
A62 - life-saving
A63 - sports
A99 - subject matter not otherwise provided for in this section
B - performing operations
B01 - physical or chemical processes or apparatus in general
B02 - crushing, pulverising, or disintegrating
B03 - separation of solid materials using liquids or using pneumatic tables or jigs
B04 - centrifugal apparatus or machines for carrying-out physical or chemical processes
B05 - spraying or atomising in general
B06 - generating or transmitting mechanical vibrations in general
B07 - separating solids from solids
B08 - cleaning
B09 - disposal of solid waste
B21 - mechanical metal-working without essentially removing material
B22 - casting
B23 - machine tools
B24 - grinding
B25 - hand tools
B26 - hand cutting tools
B27 - working or preserving wood or similar material
B28 - working cement, clay, or stone
B29 - working of plastics
B30 - presses
B31 - making articles of paper, cardboard or material worked in a manner analogous to paper
B32 - layered products
B33 - additive manufacturing technology
B41 - printing
B42 - bookbinding
B43 - writing or drawing implements
B44 - decorative arts
B60 - vehicles in general
B61 - railways
B62 - land vehicles for travelling otherwise than on rails
B63 - ships or other waterborne vessels
B64 - aircraft
B65 - conveying
B66 - hoisting
B67 - opening, closing {or cleaning} bottles, jars or similar containers
B68 - saddlery
B81 - microstructural technology
B82 - nanotechnology
B99 - subject matter not otherwise provided for in this section
C - chemistry
C01 - inorganic chemistry
C02 - treatment of water, waste water, sewage, or sludge
C03 - glass
C04 - cements
C05 - fertilisers
C06 - explosives
C07 - organic chemistry
C08 - organic macromolecular compounds
C09 - dyes
C10 - petroleum, gas or coke industries
C11 - animal or vegetable oils, fats, fatty substances or waxes
C12 - biochemistry
C13 - sugar industry
C14 - skins
C21 - metallurgy of iron
C22 - metallurgy
C23 - coating metallic material
C25 - electrolytic or electrophoretic processes
C30 - crystal growth
C40 - combinatorial technology
C99 - subject matter not otherwise provided for in this section
D - textiles
D01 - natural or man-made threads or fibres
D02 - yarns
D03 - weaving
D04 - braiding
D05 - sewing
D06 - treatment of textiles or the like
D07 - ropes
D10 - indexing scheme associated with sublasses of section d, relating to textiles
D21 - paper-making
D99 - subject matter not otherwise provided for in this section
E - fixed constructions
E01 - construction of roads, railways, or bridges
E02 - hydraulic engineering
E03 - water supply
E04 - building
E05 - locks
E06 - doors, windows, shutters, or roller blinds in general
E21 - earth drilling
E99 - subject matter not otherwise provided for in this section
F - mechanical engineering
F01 - machines or engines in general
F02 - combustion engines
F03 - machines or engines for liquids
F04 - positive - displacement machines for liquids
F05 - indexing schemes relating to engines or pumps in various subclasses of classes f01-f04
F15 - fluid-pressure actuators
F16 - engineering elements and units
F17 - storing or distributing gases or liquids
F21 - lighting
F22 - steam generation
F23 - combustion apparatus
F24 - heating
F25 - refrigeration or cooling
F26 - drying
F27 - furnaces
F28 - heat exchange in general
F41 - weapons
F42 - ammunition
F99 - subject matter not otherwise provided for in this section
G - physics
G01 - measuring
G02 - optics
G03 - photography
G04 - horology
G05 - controlling
G06 - computing
G07 - checking-devices
G08 - signalling
G09 - education
G10 - musical instruments
G11 - information storage
G12 - instrument details
G16 - information and communication technology [ict] specially adapted for specific application fields
G21 - nuclear physics
G99 - subject matter not otherwise provided for in this section
H - electricity
H01 - basic electric elements
H02 - generation
H03 - basic electronic circuitry
H04 - electric communication technique
H05 - electric techniques not otherwise provided for
H99 - subject matter not otherwise provided for in this section
Y - new / cross sectional technologies
Y02 - technologies or applications for mitigation or adaptation against climate change
Y04 - information or communication technologies having an impact on other technology areas
Y10 - technical subjects covered by former uspc

More Options ...

Title: Automated control of microfluidic devices based on machine learning

Abstract

A system is provided to automatically monitor and control the operation of a microfluidic device using machine learning technology. The system receives images of a channel of a microfluidic device collected by a camera during operation of the microfluidic device. Upon receiving an image, the system applies a classifier to the image to classify the operation of the microfluidic device as normal, in which no adjustment to the operation is needed, or as abnormal, in which an adjustment to the operation is needed. When an image is classified as normal, the system may make no adjustment to the microfluidic device. If, however, an image is classified as abnormal, the system may output an indication that the operation is abnormal, output an indication of a needed adjustment, or control the microfluidic device to make the needed adjustment.

Inventors:: Giera, Brian; Duoss, Eric; Nguyen, Du; Smith, William; Talathi, Sachin Subhash; Wilson, Aaron Creighton; Ye, Congwang

Issue Date:: 2019-09-10

Research Org.:: Lawrence Livermore National Laboratory (LLNL), Livermore, CA (United States)

Sponsoring Org.:: USDOE

OSTI Identifier:: 1576338

Patent Number(s):: 10408852

Application Number:: 15/498,282

Assignee:: Lawrence Livermore National Security, LLC (Livermore, CA)

Patent Classifications (CPCs):: B - PERFORMING OPERATIONS B01 - PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL B01L - CHEMICAL OR PHYSICAL LABORATORY APPARATUS FOR GENERAL USE

G - PHYSICS G01 - MEASURING G01N - INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES

Show more

B - PERFORMING OPERATIONS B01 - PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL B01L - CHEMICAL OR PHYSICAL LABORATORY APPARATUS FOR GENERAL USE
B01L2200/0652 - Sorting or classification of particles or molecules
B01L2200/143 - Quality control, feedback systems
B01L3/502784 - {specially adapted for droplet or plug flow, e.g. digital microfluidics

G - PHYSICS G01 - MEASURING G01N - INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
G01N15/00 - Investigating characteristics of particles
G01N15/1429 - {using an analyser being characterised by its signal processing}
G01N15/1475 - {using image analysis for extracting features of the particle}
G01N2015/149 - {Sorting the particles}
G01N2035/00643 - {detecting malfunctions in conveying systems}
G01N2035/00881 - {network configurations}
G01N35/00623 - {of instruments}
G01N35/00871 - {Communications between instruments or with remote terminals}

G - PHYSICS G05 - CONTROLLING G05B - CONTROL OR REGULATING SYSTEMS IN GENERAL
G05B13/027 - {using neural networks only}
G05B2219/37333 - Position of control valve and position of controlled actuator

G - PHYSICS G05 - CONTROLLING G05D - SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES
G05D7/0635 - {by action on throttling means
G05D7/0694 - {by action on throttling means or flow sources of very small size, e.g. microfluidics

Show less

DOE Contract Number:: AC52-07NA27344

Resource Type:: Patent

Resource Relation:: Patent File Date: 2017 Apr 26

Country of Publication:: United States

Language:: English

Subject:: 42 ENGINEERING

Citation Formats


                    Giera, Brian, Duoss, Eric, Nguyen, Du, Smith, William, Talathi, Sachin Subhash, Wilson, Aaron Creighton, and Ye, Congwang. Automated control of microfluidic devices based on machine learning.  United States: N. p., 2019. 
        Web.

Copy to clipboard


                    Giera, Brian, Duoss, Eric, Nguyen, Du, Smith, William, Talathi, Sachin Subhash, Wilson, Aaron Creighton, & Ye, Congwang. Automated control of microfluidic devices based on machine learning.  United States.

Copy to clipboard


                    Giera, Brian, Duoss, Eric, Nguyen, Du, Smith, William, Talathi, Sachin Subhash, Wilson, Aaron Creighton, and Ye, Congwang. Tue .  
        "Automated control of microfluidic devices based on machine learning".  United States.  https://www.osti.gov/servlets/purl/1576338.

Copy to clipboard


                    
@article{osti_1576338,

  title        = {Automated control of microfluidic devices based on machine learning},

  author       = {Giera, Brian and Duoss, Eric and Nguyen, Du and Smith, William and Talathi, Sachin Subhash and Wilson, Aaron Creighton and Ye, Congwang},

  abstractNote = {A system is provided to automatically monitor and control the operation of a microfluidic device using machine learning technology. The system receives images of a channel of a microfluidic device collected by a camera during operation of the microfluidic device. Upon receiving an image, the system applies a classifier to the image to classify the operation of the microfluidic device as normal, in which no adjustment to the operation is needed, or as abnormal, in which an adjustment to the operation is needed. When an image is classified as normal, the system may make no adjustment to the microfluidic device. If, however, an image is classified as abnormal, the system may output an indication that the operation is abnormal, output an indication of a needed adjustment, or control the microfluidic device to make the needed adjustment.},

  doi          = {},

  journal      = {},
number       = ,

  volume       = ,

  place        = {United States},

  year         = {2019},

  month        = {9}

}

Copy to clipboard

Patent:

Save / Share:

Export Metadata

Save to My Library

Works referenced in this record:

System and Method for Classification of Particles in a Fluid Sample
patent-application, December 2015

Valvik, Martin Christian; Larsen, Niels Agersnap; Berg, Tommy Winther
US Patent Application 14/654347; 20150347817
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20150347817

Systems and Methods for Automated Single Cell Cytological Classification in Flow
patent-application, November 2017

Masaeli, Mahdokht; Salek, Mahyar; Ashley, Euan A.
US Patent Application 15/602059; 20170333903
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20170333903

Methods and devices for generating double emulsions
patent-application, March 2016

Chiu, Daniel T.; Hakimi, Bejan; Liu, Dingsheng
US Patent Application 14/891620; 20160086785
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20160086785

System And Method For Characterizing Particulates in a Fluid Sample
patent-application, August 2017

Ashcroft, Colby; DiPaolo, Brian; Konica, Gjergji
US Patent Application 15/438092; 20170242234
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20170242234

Holographic Device and Object Sorting System
patent-application, July 2018

Schneider, Bendix; Bienstman, Peter; Dambre, Joni
US Patent Application 15/738227; 20180195945
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20180195945

Novel droplet-embedded microfibers, and methods and devices for preparing and using same
patent-application, March 2017

Stone, Howard A.; Nunes, Janine K.; Um, Eujin
US Patent Application 14/680710; 20170056331
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20170056331

Convolutional neural networks for cancer diagnosis
patent, August 2017

Kumar, Amit; Roop, John Avi
US Patent Document 9,739,783
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/9739783

Ranking approach to train deep neural nets for multilabel image annotation
patent, January 2017

Gong, Yunchao; Leung, King Hong Thomas; Toshev, Alexander Toshkov
US Patent Document 9,552,549
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/9552549

Systems and Methods for Splitting Droplets
patent-application, January 2014

Abate, Adam R.; Weitz, David A.
US Patent Application 13/979984; 20140026968
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20140026968

Melt Emulsification
patent-application, September 2011

Shum, Ho Cheung; Sun, Bingjie; Weitz, David A.
US Patent Application 13/049957; 20110229545
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20110229545

Highly sensitive optical sensor for polymerase screening
patent-application, November 2018

Chaput, John; Larsen, Andrew; Dunn, Matthew
US Patent Application 15/766716; 20180320150
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20180320150

Systems and Methods for Shell Encapsulation
patent-application, March 2013

Weitz, David A.; Shum, Ho Cheung; Zhao, Yuanjin
US Patent Application 13/586628; 20130064862
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20130064862

Processing images using deep neural networks
patent-application, March 2016

Szegedy, Christian; Vanhoucke, Vincent O.
US Patent Application 14/839452; 20160063359
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20160063359

Encapsulation Microfluidic Device
patent-application, November 2011

Vivoy, Jean-Louis; Chabert, Max
US Patent Application 13/120310; 20110285042
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20110285042

Compartmentalized Screening by Microfluidic Control
patent-application, January 2009

Griffiths, Andrew; Weitz, David; Link, Darren
US Patent Application 11/665145; 20090005254
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20090005254

Manipulation of cell nuclei in a micro-fluidic device
patent-application, December 2016

White, Mark P.; Lowe, Jr., Randall D.
US Patent Application 15/136763; 20160370266
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20160370266

Microfluidic Flow Monitoring
patent-application, September 2014

Hasson, Kenton; Dale, Gregory A.
US Patent Application 13/836301; 20140272984
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20140272984

Inferring body position in a scan
patent-application, February 2018

Gur, Yaniv; Moradi, Mehdi; Syeda-Mahmood, Tanveer F.
US Patent Application 15/220932; 20180032801
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20180032801

Device for the classification and examination of particles in fluid
patent, February 1998

Asai, Hideki; Horiuchi, Hideyuki; Yabe, Ryohei
US Patent Document 5,715,182
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/5715182

Microparticles, methods for their preparation and use
patent-application, September 2016

Utech, Stefanie; Prodanovic, Radivoje; Amstad, Esther
US Patent Application 15/035167; 20160279068
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20160279068

Image Processing Method and System for Microfluidic Devices
patent-application, May 2010

Taylor, Colin Jon; Sun, Gang
US Patent Application 12/552208; 20100119154
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20100119154

High Definition Microdroplet Printer
patent-application, March 2018

Abate, Adam R.; Sciambi, Adam R.; Cole, Russell
US Patent Application 15/520056; 20180056288
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20180056288

Mechano-sensitive microcapsules for drug delivery
patent-application, June 2018

Lee, Daeyeon; Mauck, Robert L.; Dodge, George R.
US Patent Application 15/579084; 20180169024
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20180169024

Encapsulated sensors and sensing systems for bioassays and diagnostics and methods for making and using them
patent-application, August 2016

Zhao, Weian; Kang, Dong-ku; Zhang, Kaixiang
US Patent Application 15/024735; 20160231324
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20160231324

Method and apparatus for image classification with joint feature adaptation and classifier learning
patent-application, May 2016

Kulkarni, Praveen Anil; Zepeda Salvatierra, Joaquin; Jurie, Frederic
US Patent Application 14/942302; 20160140425
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20160140425

Manipulation of Microfluidic Droplets
patent-application, January 2011

Miller, Benjamin; Hutchinson, Brian; Wilson, Andrew
US Patent Application 12/729462; 20110000560
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/20110000560

Training scoring models optimized for highly-ranked results
patent, April 2013

Bengio, Samy; Chechik, Gal; Ioffe, Sergey
US Patent Document 8,429,212
URL: https://image-ppubs.uspto.gov/dirsearch-public/print/downloadPdf/8429212

Similar Records in DOE Patents and OSTI.GOV collections:

Automated control of microfluidic devices based on machine learning

Patent Giera, Brian; Duoss, Eric B.; Nguyen, Du; ...

A system is provided to automatically monitor and control the operation of a microfluidic device using machine learning technology. The system receives images of a channel of a microfluidic device collected by a camera during operation of the microfluidic device. Upon receiving an image, the system applies a classifier to the image to classify the operation of the microfluidic device as normal, in which no adjustment to the operation is needed, or as abnormal, in which an adjustment to the operation is needed. When an image is classified as normal, the system may make no adjustment to the microfluidic device.more » « less
Full Text Available
Automated methods for scalable, parallelized enzymatic biopolymer synthesis and modification using microfluidic devices

Patent Banal, James; Berleant, Joseph Don; Shepherd, Tyson; ...

Methods for the automated template-free synthesis of user-defined sequence controlled biopolymers using microfluidic devices are described. The methods facilitate simultaneous synthesis of up to thousands of uniquely addressed biopolymers from the controlled movement and combination of regents as fluid droplets using microfluidic and EWOD-based systems. In some forms, biopolymers including nucleic acids, peptides, carbohydrates, and lipids are synthesized from step-wise assembly of building blocks based on a user-defined sequence of droplet movements. In some forms, the methods synthesize uniquely addressed nucleic acids of up to 1,000 nucleotides in length. Methods for adding, removing and changing barcodes on biopolymers are alsomore » « less
Full Text Available
Fluid control structures in microfluidic devices

Patent Mathies, Richard A.; Grover, William H.; Skelley, Alison; ...

Methods and apparatus for implementing microfluidic analysis devices are provided. A monolithic elastomer membrane associated with an integrated pneumatic manifold allows the placement and actuation of a variety of fluid control structures, such as structures for pumping, isolating, mixing, routing, merging, splitting, preparing, and storing volumes of fluid. The fluid control structures can be used to implement a variety of sample introduction, preparation, processing, and storage techniques.
Full Text Available
Fluid control structures in microfluidic devices

Patent Mathies, Richard A.; Grover, William H.; Skelley, Alison; ...

Methods and apparatus for implementing microfluidic analysis devices are provided. A monolithic elastomer membrane associated with an integrated pneumatic manifold allows the placement and actuation of a variety of fluid control structures, such as structures for pumping, isolating, mixing, routing, merging, splitting, preparing, and storing volumes of fluid. The fluid control structures can be used to implement a variety of sample introduction, preparation, processing, and storage techniques.
Full Text Available
Microfluidic devices for the controlled manipulation of small volumes

Patent Ramsey, Michael J; Jacobson, Stephen C

A method for conducting a broad range of biochemical analyses or manipulations on a series of nano- to subnanoliter reaction volumes and an apparatus for carrying out the same are disclosed. The invention is implemented on a fluidic microchip to provide high serial throughput. In particular, the disclosed device is a microfabricated channel device that can manipulate nanoliter or subnanoliter reaction volumes in a controlled manner to produce results at rates of 1 to 10 Hz per channel. The reaction volumes are manipulated in serial fashion analogous to a digital shift register. The invention has application to such problems asmore » « less
Full Text Available

Similar Records

Title: Automated control of microfluidic devices based on machine learning

Abstract

Citation Formats

System and Method for Classification of Particles in a Fluid Sample patent-application, December 2015

Systems and Methods for Automated Single Cell Cytological Classification in Flow patent-application, November 2017

Methods and devices for generating double emulsions patent-application, March 2016

System And Method For Characterizing Particulates in a Fluid Sample patent-application, August 2017

Holographic Device and Object Sorting System patent-application, July 2018

Novel droplet-embedded microfibers, and methods and devices for preparing and using same patent-application, March 2017

Convolutional neural networks for cancer diagnosis patent, August 2017

Ranking approach to train deep neural nets for multilabel image annotation patent, January 2017

Systems and Methods for Splitting Droplets patent-application, January 2014

Melt Emulsification patent-application, September 2011

Highly sensitive optical sensor for polymerase screening patent-application, November 2018

Systems and Methods for Shell Encapsulation patent-application, March 2013

Processing images using deep neural networks patent-application, March 2016

Encapsulation Microfluidic Device patent-application, November 2011

Compartmentalized Screening by Microfluidic Control patent-application, January 2009

Manipulation of cell nuclei in a micro-fluidic device patent-application, December 2016

Microfluidic Flow Monitoring patent-application, September 2014

Inferring body position in a scan patent-application, February 2018

Device for the classification and examination of particles in fluid patent, February 1998

Microparticles, methods for their preparation and use patent-application, September 2016

Image Processing Method and System for Microfluidic Devices patent-application, May 2010

High Definition Microdroplet Printer patent-application, March 2018

Mechano-sensitive microcapsules for drug delivery patent-application, June 2018

Encapsulated sensors and sensing systems for bioassays and diagnostics and methods for making and using them patent-application, August 2016

Method and apparatus for image classification with joint feature adaptation and classifier learning patent-application, May 2016

Manipulation of Microfluidic Droplets patent-application, January 2011

Training scoring models optimized for highly-ranked results patent, April 2013

System and Method for Classification of Particles in a Fluid Sample
patent-application, December 2015

Systems and Methods for Automated Single Cell Cytological Classification in Flow
patent-application, November 2017

Methods and devices for generating double emulsions
patent-application, March 2016

System And Method For Characterizing Particulates in a Fluid Sample
patent-application, August 2017

Holographic Device and Object Sorting System
patent-application, July 2018

Novel droplet-embedded microfibers, and methods and devices for preparing and using same
patent-application, March 2017

Convolutional neural networks for cancer diagnosis
patent, August 2017

Ranking approach to train deep neural nets for multilabel image annotation
patent, January 2017

Systems and Methods for Splitting Droplets
patent-application, January 2014

Melt Emulsification
patent-application, September 2011

Highly sensitive optical sensor for polymerase screening
patent-application, November 2018

Systems and Methods for Shell Encapsulation
patent-application, March 2013

Processing images using deep neural networks
patent-application, March 2016

Encapsulation Microfluidic Device
patent-application, November 2011

Compartmentalized Screening by Microfluidic Control
patent-application, January 2009

Manipulation of cell nuclei in a micro-fluidic device
patent-application, December 2016

Microfluidic Flow Monitoring
patent-application, September 2014

Inferring body position in a scan
patent-application, February 2018

Device for the classification and examination of particles in fluid
patent, February 1998

Microparticles, methods for their preparation and use
patent-application, September 2016

Image Processing Method and System for Microfluidic Devices
patent-application, May 2010

High Definition Microdroplet Printer
patent-application, March 2018

Mechano-sensitive microcapsules for drug delivery
patent-application, June 2018

Encapsulated sensors and sensing systems for bioassays and diagnostics and methods for making and using them
patent-application, August 2016

Method and apparatus for image classification with joint feature adaptation and classifier learning
patent-application, May 2016

Manipulation of Microfluidic Droplets
patent-application, January 2011

Training scoring models optimized for highly-ranked results
patent, April 2013