VTK8-Test-Failures

Hybrid - Kathleen

Name	Simple Rebaseline	Notes
cinema-a.py	Yes	view/lighting
cinema-c.py		(skipped)
cleanzonesonly.py	No	minor pixel diffs for plots, legend shifted slightly upwards. Should legends be removed from this test?
clonecopy.py		(skipped)
clonefirstref.py	Yes	minor pixel diffs
conditional.py	No	some view/lighting, but also Interpolation: conditional_04 conditional_05 conditional_06
conn_cmfe.py	Yes	view/lighting
coord_expr.py	Yes	view/lighting
curve_anim.py	Yes	view
curve_expressions.py	No	possible view clip issue with curve_exp_bin_02
cylindrical_radius.py	Yes	view/lighting
ddf.py	No	Interpolation ddf
defvar_anim.py	Yes	view/lighting
expr2engine.py	Yes	lighting
expr_cmfe.py	Yes	view/lighting
expressions.py	Yes	view/lighting
field_operators.py	No	Mostly view/lighting Missing points field_op_04 Inerpolation diffs field_op_14 field_op_16 field_op_17 field_op_18
image_proc.py	No	Interpolation hybrid_image_proc
keyframe.py	No	view/lighting, but we should take a look at the strange highlighting of the endcaps on globe keyframe_43
lambda2.py	Yes	view/lighting
lineout.py		(skipped)
locktime.py	Yes	minor pixel diffs
locus.py	No	could be just large quads split differently. look at locus_01
math_expr.py	No	quads split differently? see math_expr_02
matsel.py	Yes	view/lighting
matvf.py	Yes	view/lighting
merge_tree.py	No	Interpolation merge_tree
mesh_quality.py	Yes	view/lighting
mir.py	Yes	view/lighting
mir_cache.py	Yes	view/lighting
missingdata.py	No	Interpolation ? missingdata_0_01
movie.py		(skipped)
multivar.py	Yes	view/lighting
pos_cmfe.py	No	Mostly view/lighting, except an Interpolation case pos_cmfe_01
py_exprs.py	Yes	minor pixel diffs
qcrit.py	Yes	view/lighting
replace.py	No	the surface is no longer smooth (curv3d.silo) see Replace3
selections.py		(skipped)
selections_pp.py		(skipped)
sil.py	Yes	view/lighting
simplify_mixed.py	Yes	view
specmf.py	Yes	minor pixel diffs
symm.py	Yes	view/lighting
time_cmfe.py	Yes	view/lighting
time_deriv_cmfe.py	Yes	view/lighting
time_iteration.py	Yes	view/lighting
timelock.py	Yes	view/lighting
val4mat.py	Yes	view

Plots - Eric

Name	Simple Rebaseline	Notes
surface.py	Yes	very small rendering changes, slight view change, line style not implemented
multicolor.py	Yes	very small rendering changes
contour.py	Yes	very small rendering changes, line style not implemented
mesh.py	Yes	very small rendering changes, line style not implemented
parcoords.py	Yes	label placement changed, should submit a ticket to improve
mesh_c.py	Yes	same as mesh
pseudocolor.py	Yes	very small rendering changes
vector.py	Yes	vector stems are not being shaded, should submit a ticket to fix
scatter.py	Yes	very small rendering changes
subset.py	Yes	very small rendering changes
volumePlot.py	No	one image of a slice is blank in current, another set of images are grayscale instead of color
ray_trace.py	Yes	very small rendering changes
tensor.py	Yes	very small rendering changes, one vector plot with vector stems not being shaded
truecolor.py	Yes	very small rendering changes
label.py	No	The text looks much better, but the size is different, the 2d text is smaller and the 3d text is larger, some non-visible labels showing in 3d
singlecolor.py	Yes	very small rendering changes
curve.py	No	curves getting cut off at bottom, some markers missing, markers are distorted, markers at too large, curve with single marker a diff color wrong, curves with line missing line, current curve scale blank - current not, quad splitting differences

Session - Kevin

Name	Simple Rebaseline	Notes
restorewithsources.py	Yes	very small pixel differences
textannot.py	Yes	view/positioning
correlationsession.py	Yes	minor pixel differences
selection.py	Yes	minor pixel differences
colortable.py	Yes	grid lines are a little thicker. view/positioning
view3d.py	Yes	minor pixel differences/positioning
legendproperties.py	Yes	minor pixel differences/positioning
rect3d-contour.py	Yes	minor pixel differences
wavecontour.py	Yes	minor pixel differences
simplekeyframe.py	Yes	better rendering of the grid
sessionview.py	Yes	better rendering of the grid/outline
sessionexpression.py	Yes	lighting

Simulation - Eric

Name	Simple Rebaseline	Notes
globalids.py	Yes	very small rendering changes
domainlist.py	Yes	very small rendering changes
polyhedral.py	Yes	very small rendering changes
updateplots.py	Yes	very small rendering changes
multiblock.py	Yes	very small rendering changes, slight 2d view change - should investigate
scalar.py	Yes	very small rendering changes, slight 2d view change, labels slightly larger
materialvar.py	Yes	very small rendering changes, slight 2d view change
unstructured.py	Yes	very small rendering changes
updateplots_session.py	No	very small rendering changes, triad line thickness wrong, title moved slightly
zerocopy.py	Yes	very small rendering changes
csg.py	Yes	very small rendering changes
amr.py	Yes	very small rendering changes, slight 2d view change
life.py	Yes	very small rendering changes
ucdcurve.py	Yes	very small rendering changes
batch.py	No	very small rendering changes, batch_06* images have a extra axis line on right side
domainbounds.py	Yes	very small rendering changes
curve.py	Yes	very small rendering changes
mandelbrot.py	Yes	very small rendering changes
var.py	Yes	very small rendering changes, slight 2d view change
point.py	Yes	very small rendering changes
aresamr.py	Yes	very small rendering changes
species.py	Yes	very small rendering changes
mesh.py	No	view change?, crash, need to investigate
material.py	Yes	very small rendering changes, slight 2d view change
interleave.py	Yes	very small rendering changes

Databases - Mark

The images for any <database>.py test python file not explicitly listed here is ok to entirely rebaseline all images from that file.

In a lot of cases in 2D plots especially, I noticed we dropped lines at the extreme edges of the plot. I think that is ok in some cases and NOT ok in other cases. I think if our orig. baselines had a different set of extreme edge lines missing and that situation just changed, that is probably ok. I think if the orig. baselines had all extreme edge lines correct and the new images are dropping some, that is a problem.

Name	Notes
lata.py	lata_03 seeing through mesh plot to zone face or face lighting is different, lata_07 missing >half of vector glyph tail, lata_12 odd shading
patran.py	patran4_0 lighting or normals changed, other cases here too
pdbdatabase.py	pdb_multi_12 lighting or normals, pdb_multi_15 font size change in label plot
vtk.py	vtk_01 good example of minor line change, vtk_16 view change, vtk_23 LQDS (large quad diagonal swap), vtk_37 shading or normals
silo.py	silo_20 shading artifacts at domain boundaries or back faces showing through, silo_23 major change in y axis label position (other cases too), silo_91 funky shading issue along edges of large elements
samrai.py	samrai_copper_matvf_02 great example of LQDS and bad choice, samrai_24 domain boundary line color thrashing, samrai_34 really bad and no ideas why
pixie.py	pixie_07 really bad! distance between objects?
bov.py	label plot font size change
chgar.py	chgar_02 LQDS other cases volume plots, label font size
shapefile.py	is there some line density control in VTK-8 that we're defaulting to
h5part.py	h5part_03 shading appears better, h5part_04 I can't tell which is better
blueprint.py	blueprint_2d_json_uniform_braid LQDS, blueprint_2d_hdf5_points_braid point glyph size change, blueprint_3d_hdf5_points_braid point glyph size change , blueprint_mfem_periodic_cube_json_sol LQDS
vista.py	do we still need this test
reopen.py	reopen_3_04 better (older version had air gap between domain boundary and domain pc plot)
overlink.py	overlink_02, overlink_03 & overlink_04 (probably other cases) shading or surface nomals issue
sami.py	sami_05 shading or surface normal issue, mesh line positions relative to PC plot changed
CGNS.py	CGNS_0_04 and others odd shading artifacts in single bright pixel
netcdf.py	netcdf_1_00 and other cases lost smooth shading of facets to flat shading
openfoam.py	OpenFOAM_lagrangian_01 and other cases change in shading or light direction or diffuse vs. specular, OpenFOAM_Decomposed_01 improved and fixed a bad artifact
exodus.py	exodus_22 WTF? No ideas
xmdf.py	Xmdv_02 and other cases too label plot font size change
metadata.py	metadata_1_expr_grad_tensor_diagonal label font size change
mfem.py	input_mesh_disc-nurbs_mres_0000 improved, input_mesh_escher_mres_0000 single point artifacts, input_mesh_klein-donut_mres_0000, ex01_ex01-pipe-nurbs oddball shading, ex01_ex01-escher, input_mesh_pipe-nurbs_mres_0000, input_mesh_mobius-strip_mres_0000 seems like a sign. change in geometry (could be twisted hex)
exportdb.py	export_db_3_00 shading artifacts at domain boundaries
global_node_ids	global_node_ids10 shading change
protiendb.py	proteindb_0_01 label plot font size change
tecplot.py	tecplot_16 LQDS
mili.py	mili_01 has zbuffer contention on different colored but same positioned plans
moab.py	moab_02, zbuffer contention

Faulttolerance - Kevin

Name	Simple Rebaseline	Notes
badfile.py	Yes	Test Passed - Not images, text output
savewindow.py	Yes	Test Passed - Not images, text output

Queries - Matt

Name	Simple Rebaseline	Notes
hohlraum.py	Yes	lines are slightly off
length.py	Yes	lines are slightly off
avg_value.py	Yes	text and lines are slightly off
scf.py	Yes	text and lines are slightly off
conncomp.py	Yes	slight difference in the pixels
curvature.py	Yes	slight difference in the pixels
consistencyChecks.py	Yes	lines are slightly off. When only lines, % difference is ~50%. Could be difference line drawing algorithm
pickarray.py	No	There are new lines being drawn on these plots that do not exist in the baseline. I'm not sure about this
pick.py	Maybe	There are numerical differences in the output. If the view changed, then a different zone/node may have been picked. There are also big differences in the psuedocolor plot
queriesOverTime.py	No	most are minor differences in line drawing. AllTimeQueries_02, however is very different. This is a guess, but I think the new image is correct and the old image is an error.
line_scan.py	Yes	these are missing portions of lines
bestfitline.py	Maybe	seems like some are missing baseline images. Other than that, this looks like a rebaseline
pickNamedArgs.py	Yes	minor line diffs
scalabe2.py	Maybe	minor line diffs, but lots of lines. I think its ok but would like another set of eyes.

Rendering - Alister

Name	Simple Rebaseline	Notes
scalable2	No	May just be a view change, but the colors are slightly different. Should probably review with group.
offscreen	Yes	Looks like a view change and different annotations placement.
saveformats	Yes	Exact match.
scalable_c	No	Failed exit. The ones that did run seem like a view change.
annotation	No	Most of the diffs just look like a view change and different annotation placement. Some of them (like annot2d_20), though, may have a difference in quad splitting. Should look more closely.
viewChange	No	Many of these look like annotation placement diffs, but some of the rendered datasets may have quad splitting differences.
legends	No	Most look like simple view changes and annotation diffs, but legends_7 is drastically different (volume rendering).
image	No	View shift and quad splitting?
axistitles	No	Significant difference in axis annotation position (0 - 5) and what looks like a simple view shift.
compositing	No	Very different shading.
bigdata	Yes	Looks like a view shift and possibly different lighting.
evalcubic	Yes	Looks like a simple view shift.
colortexture	No	Drastically different (case 0): looks like a quad splitting difference. There is also a lighting difference around edges (cases 1 - 4).
timeslider	Yes	Looks like a view shift.
lighting	No	The new version looks good but much brighter.
scalable	No	Failed exit. Those that ran look like a view shift.
volume	No	Very different results for 03 and 01 (possibly different rendering techniques used).
shadows	Yes	Looks like a view shift.
transparency	Yes	Looks like a view shift.
view	No	Most of the diffs look like a view shift. 24 and others have interesting line showing up (maybe lighting and view change?). 14 looks like a possible quad splitting difference.
text2d	No	Looks like a view shift and quad splitting difference.
pixeldata	Yes	Looks like a view shift.
text3d	Yes	Looks like a view shift.
renderpoints	No	All "check points drawn as spheres" are significantly different sizes. The rest appear to be view shifts.
line2d	No	Looks like a quad splitting difference.
line3d	No	Dot and dash lines are being used but rendered.
specular	No	Significant lighting differences. It looks fine but should be reviewed with group.

Operators - Cyrus

Name	Simple Rebaseline	Notes
ic_pics.py		(skipped)
ex_surf.py	Yes	diffs look like view change
transform.py	No	view clip issue with one curve plot ops_transform08
lcs_ic_2.py	Yes	diffs look like view change
lcs.py	No	pseudocolor interp / rendering diffs
displace.py	No	pseudocolor interp / rendering diffs, see ops_disp02
elevate.py	Yes	diffs look like lighting changes (new images look better)
clip.py	No	clip fast looks different (could be better, but we need to look at it) clip_globe_fast
threeslice.py	Yes	diffs look like view or lighting change
onionpeel.py	No	diffs look like view or lighting change labels look better, but we should review bigsil_mesh_01
amr_stitch.py	Yes	diffs look like view or lighting change
ic_integration.py		(skipped)
slice.py	No	most diffs look like view or lighting change, but may be some clipping changes Some may be better: ops_Slice02 Some may be worse: ops_Slice37 ops_Slice39
tube.py	Yes	diffs look like view or lighting change
ic_pathlines.py		(skipped)
multires.py		no diffs
ic_geometry.py		(skipped)
lcs_operator.py		(skipped)
persistent_particles.py	No	most diffs look like view or lighting change points are smaller, which is probably fine -- but we should review as a team persistent_particles_03
indexselect.py	Yes	diffs look like view or lighting change
resample.py	No	interp differences operators_resample
inverse_ghost_zone.py	No	most diffs look like view or lighting change missing lines: ops_inverse_ghost_zone05
lcs_lc_1.py	Yes	diffs look like view or lighting change
sph_resample.py	Yes	diffs look like view or lighting change
isovolume.py	Yes	diffs look like view or lighting change
defer_expr.py	Yes	diffs look like view or lighting change
cart_proj.py	Yes	diffs look like view or lighting change
reflect.py	No	most diffs look like view or lighting change lighting diffs, probably ok but we should review as a team ops_refl06 ops_refl07 ops_refl08 ops_refl09 vol rendering diff ops_refl14
radial_resample.py	Yes	diffs look like view or lighting change
cracksclipper.py	Yes	diffs look like view or lighting change
box.py	Yes	diffs look like view or lighting change
threshold.py	Yes	diffs look like view or lighting change
explode.py	Yes	diffs look like view or lighting change
dual_mesh.py	Yes	diffs look like view or lighting change
lic_streamlines.py		(skipped)
ic_termination.py	Yes	diffs look like view or lighting change
moveoperators.py	Yes	diffs look like view or lighting change

Meshtype - Kathleen

Name	Simple Rebaseline	Notes
arbpoly.py	Yes	view/lighting
csg.py	Yes	view/lighting
degen_mesh.py	Yes	view/lighting
emptydomains.py	No	Seems like view/lighting, but there appears to be highlighting along back edges of non-mesh plots: emptydomains_02 emptydomains_03 emptydomains_04 emptydomains_07 emptydomains_10
globe.py	No	Mostly view/lighting, except Volume Rendering globe_04
point.py	Yes	view/lighting
rect3d.py	No	need another opinion, is this just view/lighting/opacity? rect3d