I experimented/checked a bit today. The result below might not contribute for the right solution. My insufficient understanding and the difference between environments might rather mislead to increase confuse. Just for your information.
The already-built SDK sample "CustomColor.dll" was not recognized (i.e. its icon with caption "Custom checker" is not added in the shader lists) by tS4.3, tS5.1, and "tS6.6 of tS7.61" . My environment in Japanese could add unnecessary noise to the result, though.
I got the same result even if its name is CustomColor.tss". (The document says; "a special file extension is not required but there is used *.tss by default")
I checked today:
- SDKs that don't have the already-built CustomColor.dll: sdk_ts41, sdk_ts42, sdk_ts51, sdk_ts52, sdk_tS60, sdk_tS65, sdk_tS66, sdk_tS761B8
- SDKs that have it: sdk_ts43g2
So only already-built DLL I used is; sdk_ts43g2\Samples\Shaders\CustomColor\Debug\shaders\CustomColor.dll
- My tS4.3-trial-Japanese didn't have the "Shaders" folder initially. I made it and a subfolder "Material".
- My tS5.1-trial-English (expired) has only "Spots.tss" in the "Shaders\Material\" folder.
- My tS5.1-Japanese also has only "Shaders\Material\Spots.tss". Its icon with caption "Axion Spots Shader" appears in the color shader list (and it gives pattern like cow). After I removed the Spots.tss from the "Material" folder and restart the tS, actually its icon disappears from the list. After I restored the file, the icon appears again. However adding the already-built CustomColor.dll (or renamed "CustomColor.tss") causes no change.
- My tS7.61 has two TSS file (Spots.tss and vomatshader.tss) and four LUA files in the "tS\Shaders\Material\" folder. The Spots.tss's appearance and function are same with tS5.1. Removing and restoring Spots.tss (followed by tS restart) also behave as with the tS5.1.
I'm using tS cores below:
- tS4.3 trial version (Japanese, named "trueSpace PRO". I don't know the difference between it and the English version.). Windows Vista Ultimate SP2.
- tS5.1 trial English version (expired). Windows Vista Ultimate SP2.
- tS5.1 (product version in Japanese, named "trueSpace REAL". I believe it is tS5.1+ConversionPak.). Windows 8.1
- tS7.61 installed in "C:\". Windows 8.1
Another (irresponsible) guess. The interface of its property panel (dialog) could disturb the recognition?? I recommend you try to separate (remove) code of right-click callback.
2.7 Sample code
2.7.1 Using custom checker
Behaviour of the custom checker shader is similar to built-in shaders, i.e. it has one property panel (dialog) which contains its parameters. This panel can be displayed by rightclicking on the color shader preview. Parameters of the shader are: even color, odd color, size. Click on the colored button in the panel to change color ? Windows common color dialogbox will be displayed. Size parameter can be changed using the keyboard only. To register changes press “Apply” button.