You must use a web service or wcf service to access the silverlight applications host website application and session objects.
The host website needs a web service with the following code.
<WebMethod(EnableSession:=True)_
Public Sub SetText(ByVal value As String)
Session("Text") …