(a) From symmetry in the situation we expect the magnetic field inside the solenoid to circulate about the axis. Consider a circular Amperian loop of radius \(r\) around the axis with \(a\lt r\lt b\text{.}\) Then, from Ampere’s law we will have
\begin{equation*}
2\pi\;r\:B = \mu_0\:N\:I,
\end{equation*}
since \(N\) currents will pass through the are of the Amperian loop. This shows that the magnetic field inside the solenoid is not constant but depends on the distance \(r\) from the axis.
\begin{equation*}
B = \dfrac{\mu_0\:N\:I}{2\pi}\:\dfrac{1}{r}.\ \ \ \ (1)
\end{equation*}
This is different from what you know for a straight solenoid, where the magnetic field is constant in the space of the solenoid. The flux through the cross-section of the present solenoid can be obtained by integrating the magnetic field in (1) over the area of cross-section of the toroid.
\begin{align*}
\Phi \amp = \int_a^b\: \dfrac{\mu_0\:N\:I}{2\pi}\:\dfrac{1}{r}\times h\: dr\\
\amp = \dfrac{\mu_0\:N\:I\: h}{2\pi}\:\ln\left( \dfrac{b}{a}\right).
\end{align*}
Factoring out current gives the self-inductance \(L\) of the toroid.
\begin{equation*}
L = \dfrac{\Phi}{L} = \dfrac{\mu_0\:N\: h}{2\pi}\:\ln\left( \dfrac{b}{a}\right)
\end{equation*}