close
Warning:
Can't synchronize with repository "(default)" (/var/svn/tolp does not appear to be a Subversion repository.). Look in the Trac log for more information.
- Timestamp:
-
Dec 24, 2010, 3:23:01 PM (15 years ago)
- Author:
-
Víctor de Buen Remiro
- Comment:
-
--
Legend:
- Unmodified
- Added
- Removed
- Modified
-
|
v1
|
v2
|
|
| 20 | 20 | of the likelihood (except an additive constant), its gradient and its hessian, |
| 21 | 21 | and an optional set of constraining inequations, in order to define the feasible |
| 22 | | region. Each inequation can be linear or not and the gradient and hessian must |
| | 22 | region. Each inequation can be linear or not and the gradient must |
| 23 | 23 | be also calculated. Note that this implies that priors should be continuous and |
| 24 | | two times differentiable but this an admisible restricion in almost all cases. |
| | 24 | two times differentiable and restrictions must be continuous and differerentiable, |
| | 25 | but this an admisible restricion in almost all cases. |
| | 26 | |
| | 27 | == Chained priors == |
| | 28 | |
| | 29 | A prior can depend on a set of parameters that can be defined as constant |
| | 30 | values or another subset of the model variables. For example we can define |
| | 31 | hierarquical structures among the variables using a latent variable that is |
| | 32 | the average of a normal prior for a subset of variables. We also can consider |
| | 33 | that the varianze of these normal prior is another variable and to define |
| | 34 | an inverse chi-square prior over this one. |
| 25 | 35 | |
| 26 | 36 | == Non informative priors == |
| … |
… |
|
| 46 | 56 | |
| 47 | 57 | === Polytope prior === |
| 48 | | A polytope is defined by a system of arbitrary linear inequalities |
| | 58 | A polytope is defined by a system of arbitrary linear inequalities [[BR]] |
| 49 | 59 | |
| 50 | 60 | [[LatexEquation( A\beta\leq a\wedge A\in\mathbb{R}^{r\times n}\wedge a\in\mathbb{R}^{r} )]] |
| | 61 | |
| | 62 | We can define this type of prior bye means of a set of [[LatexEquation( r )]] |
| | 63 | inequations due NonLinGloOpt doesn't have any special behaviour for linear |
| | 64 | inequations, and it could be an inefficient implementation. |
| | 65 | |
| | 66 | However we can define just one non linear inequation that is equivalent to the |
| | 67 | full set of linear inequations. If we define |
| | 68 | |
| | 69 | [[LatexEquation( d\left(\beta\right)=A\beta-a=\left(d_{k}\left(\beta\right)\right)_{k=1\ldots r} )]] |
| | 70 | |
| | 71 | then |
| | 72 | |
| | 73 | [[LatexEquation( D_{k}\left(\beta\right)=\begin{cases} 0 & \forall d_{k}\left(\beta\right)\leq0\\ d_{k}\left(\beta\right) & \forall d_{k}\left(\beta\right)>0\end{cases} )]] |
| | 74 | |
| | 75 | is a continuous function in [[LatexEquation( \mathbb{R}^{n} )]] and |
| | 76 | |
| | 77 | [[LatexEquation( D_{k}^{3}\left(\beta\right)=\begin{cases} 0 & \forall d_{k}\left(\beta\right)\leq0\\ d_{k}^{3}\left(\beta\right) & \forall d_{k}\left(\beta\right)>0\end{cases} )]] |
| | 78 | |
| | 79 | is a continuous and differentiable in [[LatexEquation( \mathbb{R}^{n} )]] |
| | 80 | |
| | 81 | [[LatexEquation( \frac{\partial D_{k}^{3}\left(\beta\right)}{\partial\beta_{i}}=\begin{cases} 0 & \forall d_{k}\left(\beta\right)\leq0\\ 3d_{k}^{2}\left(\beta\right)A_{ki} & \forall d_{k}\left(\beta\right)>0\end{cases} )]] |
| | 82 | |
| | 83 | The feasibility condition can then be defined as a single continuous nonlinear |
| | 84 | inequality and twice differentiable everywhere |
| | 85 | |
| | 86 | [[LatexEquation( g\left(\beta\right)=\underset{k=1}{\overset{r}{\sum}}D_{k}^{3}\left(\beta\right)\leq0 )]] |
| | 87 | |
| | 88 | The gradient of this function is |
| | 89 | |
| | 90 | [[LatexEquation( \frac{\partial g\left(\beta\right)}{\partial\beta_{i}}=3\underset{k=1}{\overset{r}{\sum}}D_{k}^{2}\left(\beta\right)A_{ki} )]] |
| | 91 | |
| | 92 | |
| | 93 | == Multinormal prior == |
| | 94 | |
| | 95 | == Scalar bounded normal prior == |
| | 96 | |
| | 97 | == Inverse chi-square prior == |
| | 98 | |
| | 99 | |