[go: nahoru, domu]

Monte Carlo method: Difference between revisions

Content deleted Content added
Citation bot (talk | contribs)
Removed proxy/dead URL that duplicated identifier. | Use this bot. Report bugs. | #UCB_CommandLine
Rescuing 5 sources and tagging 0 as dead.) #IABot (v2.0.9.5) (AManWithNoPlan - 15896
Line 51:
 
The use of [[Sequential Monte Carlo method|Sequential Monte Carlo]] in advanced [[signal processing]] and [[Bayesian inference]] is more recent. It was in 1993, that Gordon et al., published in their seminal work<ref>{{cite journal|title=Novel approach to nonlinear/non-Gaussian Bayesian state estimation |journal=IEE Proceedings F - Radar and Signal Processing |date=April 1993 |issn=0956-375X |pages=107–113 |volume=140 |issue=2 |author-first1=N.J. |author-last1=Gordon |author-first2=D.J. |author-last2=Salmond |author-first3 = A.F.M. |author-last3=Smith |doi=10.1049/ip-f-2.1993.0015 |s2cid=12644877 }}</ref> the first application of a Monte Carlo [[Resampling (statistics)|resampling]] algorithm in Bayesian statistical inference. The authors named their algorithm 'the bootstrap filter', and demonstrated that compared to other filtering methods, their bootstrap algorithm does not require any assumption about that state-space or the noise of the system. We also quote another pioneering article in this field of Genshiro Kitagawa on a related "Monte Carlo filter",<ref>{{cite journal
|author-last=Kitagawa |author-first=G. |year=1996 |title=Monte carlo filter and smoother for non-Gaussian nonlinear state space models |volume=5 |issue=1 |journal=Journal of Computational and Graphical Statistics |pages=1–25 |doi=10.2307/1390750 |jstor=1390750}}</ref> and the ones by Pierre Del Moral<ref name="dm9622">{{cite journal |author-last1=Del Moral |author-first1=Pierre |title=Non Linear Filtering: Interacting Particle Solution. |journal=Markov Processes and Related Fields |date=1996 |volume=2 |issue=4 |pages=555–580 |url=http://web.maths.unsw.edu.au/~peterdel-moral/mprfs.pdf |access-date=2015-06-11 |archive-date=2016-03-04 |archive-url=https://web.archive.org/web/20160304052857/http://web.maths.unsw.edu.au/~peterdel-moral/mprfs.pdf |url-status=dead }}</ref> and Himilcon Carvalho, Pierre Del Moral, André Monin and Gérard Salut<ref>{{cite journal |author-last1=Carvalho |author-first1=Himilcon |author-last2=Del Moral |author-first2=Pierre |author-last3=Monin |author-first3=André |author-last4=Salut |author-first4=Gérard |title=Optimal Non-linear Filtering in GPS/INS Integration. |journal=IEEE Transactions on Aerospace and Electronic Systems |date=July 1997 |volume=33 |issue=3 |pages=835–850 |url=http://homepages.laas.fr/monin/Version_anglaise/Publications_files/GPS.pdf |bibcode=1997ITAES..33..835C |doi=10.1109/7.599254 |s2cid=27966240 |access-date=2015-06-11 |archive-date=2022-11-10 |archive-url=https://web.archive.org/web/20221110053359/https://homepages.laas.fr/monin/Version_anglaise/Publications_files/GPS.pdf |url-status=dead }}</ref> on particle filters published in the mid-1990s. Particle filters were also developed in signal processing in 1989–1992 by P. Del Moral, J. C. Noyer, G. Rigal, and G. Salut in the LAAS-CNRS in a series of restricted and classified research reports with STCAN (Service Technique des Constructions et Armes Navales), the IT company DIGILOG, and the [https://www.laas.fr/public/en LAAS-CNRS] (the Laboratory for Analysis and Architecture of Systems) on radar/sonar and GPS signal processing problems.<ref>P. Del Moral, G. Rigal, and G. Salut. "Estimation and nonlinear optimal control: An unified framework for particle solutions". LAAS-CNRS, Toulouse, Research Report no. 91137, DRET-DIGILOG- LAAS/CNRS contract, April (1991).</ref><ref>P. Del Moral, G. Rigal, and G. Salut. "Nonlinear and non Gaussian particle filters applied to inertial platform repositioning." LAAS-CNRS, Toulouse, Research Report no. 92207, STCAN/DIGILOG-LAAS/CNRS Convention STCAN no. A.91.77.013, (94p.) September (1991).</ref><ref>P. Del Moral, G. Rigal, and G. Salut. "Estimation and nonlinear optimal control: Particle resolution in filtering and estimation: Experimental results". Convention DRET no. 89.34.553.00.470.75.01, Research report no.2 (54p.), January (1992).</ref><ref>P. Del Moral, G. Rigal, and G. Salut. "Estimation and nonlinear optimal control: Particle resolution in filtering and estimation: Theoretical results".
Convention DRET no. 89.34.553.00.470.75.01, Research report no.3 (123p.), October (1992).</ref><ref>P. Del Moral, J.-Ch. Noyer, G. Rigal, and G. Salut. "Particle filters in radar signal processing: detection, estimation and air targets recognition". LAAS-CNRS, Toulouse, Research report no. 92495, December (1992).</ref><ref>P. Del Moral, G. Rigal, and G. Salut. "Estimation and nonlinear optimal control: Particle resolution in filtering and estimation". Studies on: Filtering, optimal control, and maximum likelihood estimation. Convention DRET no. 89.34.553.00.470.75.01. Research report no.4 (210p.), January (1993).</ref> These Sequential Monte Carlo methodologies can be interpreted as an acceptance-rejection sampler equipped with an interacting recycling mechanism.
 
Line 144:
The net effect, over the course of many simulated games, is that the value of a node representing a move will go up or down, hopefully corresponding to whether or not that node represents a good move.
 
Monte Carlo Tree Search has been used successfully to play games such as [[Go (game)|Go]],<ref>{{cite book|chapter=Parallel Monte-Carlo Tree Search |doi=10.1007/978-3-540-87608-3_6 |volume=5131 |pages=60–71 |series=Lecture Notes in Computer Science |year=2008 |author-last1=Chaslot |author-first1=Guillaume M. J. -B |author-last2=Winands |author-first2=Mark H. M. |author-last3=Van Den Herik |author-first3=H. Jaap |title=Computers and Games |isbn=978-3-540-87607-6 |citeseerx=10.1.1.159.4373}}</ref> [[Tantrix]],<ref>{{cite report|url=https://www.tantrix.com/Tantrix/TRobot/MCTS%20Final%20Report.pdf |title=Monte-Carlo Tree Search in the game of Tantrix: Cosc490 Final Report |author-last=Bruns |author-first=Pete}}</ref> [[Battleship (game)|Battleship]],<ref>{{cite web |url=http://www0.cs.ucl.ac.uk/staff/D.Silver/web/Publications_files/pomcp.pdf |title=Monte-Carlo Planning in Large POMDPs |author-first1=David |author-last1=Silver |author-first2=Joel |author-last2=Veness |website=0.cs.ucl.ac.uk |access-date=28 October 2017 |archive-date=18 July 2016 |archive-url=https://web.archive.org/web/20160718050040/http://www0.cs.ucl.ac.uk/staff/d.silver/web/Publications_files/pomcp.pdf |url-status=dead }}</ref> [[Havannah (board game)|Havannah]],<ref>{{cite book|chapter=Improving Monte–Carlo Tree Search in Havannah |doi=10.1007/978-3-642-17928-0_10 |volume=6515 |pages=105–115|bibcode=2011LNCS.6515..105L |series=Lecture Notes in Computer Science |year=2011 |author-last1=Lorentz |author-first1=Richard J. |title=Computers and Games |isbn=978-3-642-17927-3}}</ref> and [[Arimaa]].<ref>{{cite web|url=http://www.arimaa.com/arimaa/papers/ThomasJakl/bc-thesis.pdf |author-first=Tomas |author-last=Jakl |title=Arimaa challenge – comparison study of MCTS versus alpha-beta methods |website=Arimaa.com |access-date=28 October 2017}}</ref>
 
{{See also|Computer Go}}
Line 235:
=== Sources ===
{{refbegin}}
* {{cite journal |first = Herbert L. |last = Anderson |author-link = Herbert L. Anderson |url = http://library.lanl.gov/cgi-bin/getfile?00326886.pdf |title = Metropolis, Monte Carlo and the MANIAC |journal = [[Los Alamos Science]] |volume = 14 |pages = 96–108 |year = 1986 }}
* {{cite journal |last = Benov |first = Dobriyan M. |title=The Manhattan Project, the first electronic computer and the Monte Carlo method |journal = Monte Carlo Methods and Applications |volume = 22 |issue = 1 |pages = 73–79 |year=2016 |doi=10.1515/mcma-2016-0102 |s2cid = 30198383 }}
* {{cite journal |first=Stephan A. |last=Baeurle |title = Multiscale modeling of polymer materials using field-theoretic methodologies: A survey about recent developments |journal = Journal of Mathematical Chemistry|volume=46 |issue=2 |pages=363–426 |year=2009 |doi = 10.1007/s10910-008-9467-3 |s2cid=117867762 }}
Line 243:
* {{cite book |last = Davenport |first=J. H. |date=1992 |title=Papers from the international symposium on Symbolic and algebraic computation - ISSAC '92 |chapter=Primality testing revisited |pages=123–129 |doi = 10.1145/143242.143290 |isbn = 978-0-89791-489-5 |year=1992 |citeseerx=10.1.1.43.9296 |s2cid=17322272 }}
* {{cite book |title=Sequential Monte Carlo methods in practice |last1=Doucet |first1=Arnaud |last2=Freitas |first2=Nando de |last3=Gordon |first3=Neil |year=2001 |publisher=Springer |location=New York |isbn=978-0-387-95146-1 }}
* {{cite journal |last = Eckhardt |first = Roger |year = 1987 |title = Stan Ulam, John von Neumann, and the Monte Carlo method |journal = Los Alamos Science |issue = 15 |pages = 131–137 |url = http://library.lanl.gov/cgi-bin/getfile?15-13.pdf }}
* {{cite book |title=Monte Carlo: Concepts, Algorithms, and Applications |last=Fishman |first=G. S. |year=1995 |publisher=Springer |location=New York |isbn = 978-0-387-94527-9 }}
* {{cite journal |title = A Monte Carlo tool to simulate breast cancer screening programmes | author = C. Forastero and L. Zamora and D. Guirado and A. Lallena |journal = Phys. Med. Biol. |volume = 55 |issue = 17 |pages = 5213–5229 |year = 2010 |doi = 10.1088/0031-9155/55/17/021 |pmid = 20714045 |bibcode = 2010PMB....55.5213F | s2cid = 30021759 }}
* {{cite journal |first = Leslie M. |last = Golden |title = The Effect of Surface Roughness on the Transmission of Microwave Radiation Through a Planetary Surface |journal = [[Icarus (journal)|Icarus]] |volume = 38 |year = 1979 |pages = 451–455 |bibcode = 1979Icar...38..451G |doi = 10.1016/0019-1035(79)90199-4 |issue = 3 }}
* {{cite book |title = An Introduction to Computer Simulation Methods, Part 2, Applications to Physical Systems |last1 = Gould |first1 = Harvey |last2=Tobochnik |first2=Jan |year=1988 |publisher=Addison-Wesley |location = Reading |isbn=978-0-201-16504-3 }}
* {{cite book |first1=Charles |last1=Grinstead |first2= J. Laurie |last2=Snell |title=Introduction to Probability |url=https://archive.org/details/flooved3489 |pages = [https://archive.org/details/flooved3489/page/n19 10]–11 |publisher=[[American Mathematical Society]] |year= 1997 }}
* {{cite book |title = Monte Carlo Methods |last1 = Hammersley |first1=J. M. |last2=Handscomb |first2=D. C. |year=1975 |publisher=Methuen |location=London |isbn=978-0-416-52340-9 }}
* {{cite book |last=Hartmann |first=A.K. |year=2009 |title=Practical Guide to Computer Simulations |publisher=World Scientific |isbn=978-981-283-415-7 |url = http://www.worldscibooks.com/physics/6988.html |archive-url = https://web.archive.org/web/20090211113048/http://worldscibooks.com/physics/6988.html |url-status=dead |archive-date=2009-02-11 }}
* {{cite book |first=Douglas |last=Hubbard |title = How to Measure Anything: Finding the Value of Intangibles in Business |url=https://archive.org/details/howtomeasureanyt00hubb_773 |url-access=limited |page= [https://archive.org/details/howtomeasureanyt00hubb_773/page/n64 46] |publisher=[[John Wiley & Sons]] |year= 2007 |isbn=9780470110126 }}
* {{cite book |first=Douglas |last=Hubbard |title=The Failure of Risk Management: Why It's Broken and How to Fix It |publisher= [[John Wiley & Sons]] |year=2009 }}
* {{cite book |title=Judgement under Uncertainty: Heuristics and Biases |last1 = Kahneman |first1 = D. |last2=Tversky |first2 = A. |year=1982 |publisher=Cambridge University Press }}
* {{cite book |first1=Malvin H. |last1=Kalos |first2=Paula A. |last2=Whitlock |title=Monte Carlo Methods |publisher=[[Wiley-VCH]] |year=2008 |isbn=978-3-527-40760-6 }}
* {{cite book |title=Handbook of Monte Carlo Methods |last1 = Kroese |first1=D. P. |last2=Taimre |first2 = T. |last3=Botev |first3=Z.I. |year=2011 |publisher=[[John Wiley & Sons]] |location=New York |isbn=978-0-470-17793-8 |page=772 |url = http://www.montecarlohandbook.org }}
* {{cite journal |first1 = H. T.|last1 = MacGillivray |first2 = R. J. |last2=Dodd |title=Monte-Carlo simulations of galaxy systems |journal=[[Astrophysics and Space Science]] |volume = 86 |issue= 2 |pages= 419–435 |year= 1982 |doi = 10.1007/BF00683346 |s2cid = 189849365 }}
* {{cite book |title=Stochastic Simulation in Physics |last=MacKeown |first = P. Kevin |year=1997 |publisher=Springer |location=New York |isbn=978-981-3083-26-4 }}
* {{cite journal |last = Metropolis |first = N. |author-link = Nicholas Metropolis |url = http://library.lanl.gov/cgi-bin/getfile?15-12.pdf |title = The beginning of the Monte Carlo method |journal = Los Alamos Science |issue = 1987 Special Issue dedicated to Stanislaw Ulam |pages = 125–130 |year = 1987 }}
* {{cite journal |last1 = Metropolis |first1 = N. |author1-link = Nicholas Metropolis |last2=Rosenbluth |first2=Arianna W.|last3=Rosenbluth |first3=Marshall N. |last4=Teller |first4=Augusta H. |last5=Teller |first5=Edward |year=1953 |title=Equation of State Calculations by Fast Computing Machines |journal=Journal of Chemical Physics |volume=21 |issue=6 |page=1087 |doi = 10.1063/1.1699114 |bibcode = 1953JChPh..21.1087M |title-link = Equation of State Calculations by Fast Computing Machines |osti = 4390578 |s2cid = 1046577 }}
* {{cite journal |last1 = Metropolis |first1 = N. |author1-link = Nicholas Metropolis |last2 = Ulam |first2 = S. |author-link2=Stanislaw Ulam |year=1949 |title = The Monte Carlo Method |journal = Journal of the American Statistical Association |volume=44 |issue=247 |pages=335–341 |doi = 10.1080/01621459.1949.10483310 |pmid=18139350 |jstor=2280232 }}
* {{cite journal |doi = 10.1002/prot.340150104 |title = Insertion of peptide chains into lipid membranes: an off-lattice Monte Carlo dynamics model |first1 = M. |last1 = Milik |first2 = J. |last2 = Skolnick |journal = Proteins |volume = 15 |issue = 1 |pages = 10–25 |date = Jan 1993 |pmid = 8451235 |s2cid = 7450512 |url = https://semanticscholar.org/paper/793bd7ab0e505ef5d12ed2f0798b22675e088407 }}
* {{cite journal |last1 = Mosegaard |first1 = Klaus |last2 = Tarantola |first2 = Albert |year = 1995 |title = Monte Carlo sampling of solutions to inverse problems |journal = J. Geophys. Res. |volume = 100 |number = B7 |pages = 12431–12447 |doi = 10.1029/94JB03097 |url = http://www.math.pitt.edu/~cbsg/Materials/MonteCarlo_latex.pdf |bibcode = 1995JGR...10012431M |access-date = 2017-11-01 |archive-date = 2021-03-10 |archive-url = https://web.archive.org/web/20210310023658/http://www.math.pitt.edu/~cbsg/Materials/MonteCarlo_latex.pdf |url-status = dead }}
* {{cite journal |title = Monte Carlo Simulations of Proteins in Cages: Influence of Confinement on the Stability of Intermediate States |first1=P. |last1=Ojeda |first2=M. |last2=Garcia |first3=A. |last3=Londono |first4=N.Y. |last4=Chen |journal = Biophys. J. |volume = 96 |issue = 3 |pages = 1076–1082 |date=Feb 2009 |doi = 10.1529/biophysj.107.125369 |pmid = 18849410 |pmc = 2716574 |bibcode = 2009BpJ....96.1076O }}
* {{cite journal |doi=10.1504/IJVD.2001.001963 |last1 = Int Panis |first1 = L. |last2 = De Nocker |first2 = L. |last3 = De Vlieger |first3 = I. |last4= Torfs |first4=R. |year=2001 |title=Trends and uncertainty in air pollution impacts and external costs of Belgian passenger car traffic|journal= International Journal of Vehicle Design |volume=27 |issue=1–4 |pages=183–194 }}
Line 268:
* {{cite book |last1 = Press |first1 = William H. |last2 = Teukolsky |first2 = Saul A. |last3 = Vetterling |first3 = William T. |last4 = Flannery |first4 = Brian P. |title = Numerical Recipes in Fortran 77: The Art of Scientific Computing |edition = 2nd |series = Fortran Numerical Recipes |volume = 1 |year = 1996 |orig-year = 1986 |publisher = [[Cambridge University Press]] |isbn=978-0-521-43064-7 }}
* {{cite book |last = Ripley |first = B. D. |title = Stochastic Simulation |publisher = [[Wiley & Sons]] |year=1987 }}
* {{cite book |title = Monte Carlo Statistical Methods |last1=Robert |first1 = C. |last2 = Casella |first2 = G. |year=2004 |edition=2nd |publisher=Springer |location=New York |isbn=978-0-387-21239-5 |url=https://archive.org/details/springer_10.1007-978-1-4757-4145-2 }}
* {{cite book |title = Simulation and the Monte Carlo Method |last1 = Rubinstein |first1 = R. Y. |last2 = Kroese |first2 = D. P. |year=2007 |edition=2nd |publisher = John Wiley & Sons |location=New York |isbn = 978-0-470-17793-8 }}
* {{cite journal |last = Savvides |first = Savvakis C. |title = Risk Analysis in Investment Appraisal |journal = Project Appraisal Journal |year = 1994 |volume = 9 |issue = 1 |doi = 10.2139/ssrn.265905 |s2cid = 2809643 |url = https://mpra.ub.uni-muenchen.de/10035/1/MPRA_paper_10035.pdf }}
* {{cite book |last1=Sawilowsky |first1=Shlomo S. |last2=Fahoome |first2=Gail C. |year=2003 |title=Statistics via Monte Carlo Simulation with Fortran |location=Rochester Hills, MI |publisher=JMASM |isbn=978-0-9740236-0-1}}
* {{cite journal |last=Sawilowsky |first=Shlomo S. |title=You think you've got trivials? |journal=[[Journal of Modern Applied Statistical Methods]] |volume=2 |issue=1 |pages=218–225 |year=2003 |doi=10.22237/jmasm/1051748460 |doi-access=free |url=https://digitalcommons.wayne.edu/cgi/viewcontent.cgi?article=1744&context=jmasm }}
* {{cite conference |conference=Neural Information Processing Systems 2010 |last1=Silver |first1=David |last2=Veness |first2=Joel |year=2010 |title=Monte-Carlo Planning in Large POMDPs |editor1-last=Lafferty |editor1-first=J. |editor2-last=Williams |editor2-first=C. K. I. |editor3-last=Shawe-Taylor |editor3-first=J. |editor4-last=Zemel |editor4-first=R. S. |editor5-last=Culotta |editor5-first=A. |book-title=Advances in Neural Information Processing Systems 23 |publisher=Neural Information Processing Systems Foundation |url=http://books.nips.cc/papers/files/nips23/NIPS2010_0740.pdf |access-date=2011-03-15 |archive-date=2012-05-25 |archive-url=https://web.archive.org/web/20120525143936/http://books.nips.cc/papers/files/nips23/NIPS2010_0740.pdf |url-status=dead }}
* {{cite book |first=László |last=Szirmay-Kalos |title=Monte Carlo Methods in Global Illumination - Photo-realistic Rendering with Randomization |publisher=VDM Verlag Dr. Mueller e.K. |year=2008 |isbn=978-3-8364-7919-6}}
* {{cite book |title = Inverse Problem Theory |last = Tarantola |first = Albert |author-link = Albert Tarantola |year = 2005 |publisher = Society for Industrial and Applied Mathematics |location = Philadelphia |isbn = 978-0-89871-572-9 |url = http://www.ipgp.jussieu.fr/~tarantola/Files/Professional/SIAM/index.html }}