The last-success stopping problem with random observation times
Abstract Suppose N independent Bernoulli trials with success probabilities $$p_1, p_2,\ldots $$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:msub> <mml:mi>p</mml:mi> <mml:mn>1</mml:mn> </mml:msub> <mml:mo>,</mml:mo> <mml:msub> <mml:mi>p</mml:mi> <mml:mn>2</mml:mn> </mml:msub> <mml:mo>,</mml:mo> <mml:mo>…</mml:mo> </mml:mrow> </mml:math> are observed sequentially at times of a mixed binomial process. The task is to maximise, by using a nonanticipating stopping strategy, the probability of stopping at the last success. The case $$p_k=1/k$$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:msub> <mml:mi>p</mml:mi> <mml:mi>k</mml:mi> </mml:msub> <mml:mo>=</mml:mo> <mml:mn>1</mml:mn> <mml:mo>/</mml:mo> <mml:mi>k</mml:mi> </mml:mrow> </mml:math> has been studied by many authors as a version of the familiar best choice problem, where both N and the observation times are random. We consider a more general profile $$p_k=\theta /(\theta +k-1)$$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:msub> <mml:mi>p</mml:mi> <mml:mi>k</mml:mi> </mml:msub> <mml:mo>=</mml:mo> <mml:mi>θ</mml:mi> <mml:mo>/</mml:mo> <mml:mrow> <mml:mo>(</mml:mo> <mml:mi>θ</mml:mi> <mml:mo>+</mml:mo> <mml:mi>k</mml:mi> <mml:mo>-</mml:mo> <mml:mn>1</mml:mn> <mml:mo>)</mml:mo> </mml:mrow> </mml:mrow> </mml:math> and assume that the prior distribution of N is negative binomial with shape parameter $$\nu $$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mi>ν</mml:mi> </mml:math> , so the arrivals occur at times of a mixed Poisson process. The setting with two parameters offers a high flexibility in understanding the nature of the optimal strategy, which we show is intrinsically related to monotonicity properties of the Gaussian hypergeometric function. Using this connection, we find that the myopic stopping strategy is optimal if and only if $$\nu \ge \theta $$ <mml:math xmlns:mml="http://www.w3.org/1998/Math/MathML"> <mml:mrow> <mml:mi>ν</mml:mi> <mml:mo>≥</mml:mo> <mml:mi>θ</mml:mi> </mml:mrow> </mml:math> . Furthermore, we derive formulas to assess the winning probability and discuss limit forms of the problem for large N .
Authors
- Zakaria Derbazi (ORCID: https://orcid.org/0000-0003-3779-6981)
- Alexander Gnedin
Institutions
- Queen Mary University of London (GB)
Publication Details
- Journal
- Mathematical Methods of Operations Research
- Published
- 2024-10-19
- DOI
- https://doi.org/10.1007/s00186-024-00880-1
- Primary Topic
- Optimization and Search Problems
- Type
- article
- Field-Weighted Citation Impact
- 0.00