← Back to AI Foundations
High School Lab

Neural Net Internals Explorer

Inspect every weight and activation of a small network — then train it with real gradient descent.

Activation Function

σ(z) = 1 / (1 + e⁻ᶻ) — smooth, output in (0, 1), derivative = a(1−a)

Input Values

0.000
1.000

Input → Hidden Weights (W)

-0.355
0.340
-0.309
0.569
0.786
-0.630

Hidden Biases (b_h)

0.701
0.182
0.050

Hidden → Output Weights (v)

-0.751
-0.633
0.738

Output Bias (b_o)

-0.264

Network Diagram

Line thickness = |weight|; cyan = positive, red = negative. Circle fill = activation level.

Live Activations

Inputs: x₁ = 0.000, x₂ = 1.000

Hidden Layer

h1: z = 1.2700a = 0.7808
h2: z = 0.9681a = 0.7247
h3: z = -0.5797a = 0.3590

Output

z_o = -1.0445ŷ = 0.2603

The Math (Forward Pass)

For each hidden neuron j (1..3):

z_j = w[x1→hj]·x1 + w[x2→hj]·x2 + b_hj

a_j = act(z_j)

Output:

z_o = v1·a1 + v2·a2 + v3·a3 + b_o

ŷ = act(z_o)